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Abstract 

A lot of approaches, each following a different strategy, have been proposed in 
the literature to provide AdaBoost with cost-sensitive properties. In the first 
part of this series of two papers, we have presented these algorithms in a ho¬ 
mogeneous notational framework, proposed a clustering scheme for them and 
performed a thorough theoretical analysis of those approaches with a fully the¬ 
oretical foundation. The present paper, in order to complete our analysis, is 
focused on the empirical study of all the algorithms previously presented over a 
wide range of heterogeneous classification problems. The results of our experi¬ 
ments, confirming the theoretical conclusions, seem to reveal that the simplest 
approach, just based on cost-sensitive weight initialization, is the one showing 
the best and soundest results, despite having been recurrently overlooked in the 
literature. 
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1. Introduction 

AdaBoost [T] , the quintessential boosting [5] algorithm and one of the main 
representatives of the Ensemble Classifiers [3] paradigm, has been subject of 
extensive research in the fields of machine learning, pattern recognition and 
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computer vision during the last few years (e.g. H[31 El[510[Hill]), attracting 
an attention “rarely matched in computational intelligence” [3]. 

In practice, among the different scenarios for classification, those involving 
cost-sensitive or asymmetric conditions (e.g. disaster prediction, fraud detec¬ 
tion, medical diagnosis, object detection, etc.) hold a noteworthy position. In 
those cases, different decisions may have different associated costs (depending 
on the nature of the decision or on class priors) so that obtained classifiers must 
focus their attention in the rare/most valuable class [151 [T51IH] . 

The intersection between these two worlds, AdaBoost and Cost-Sensitive 
learning, is represented by a significant set of works in the literature devoted to 
provide AdaBoost with asymmetric properties (e.g. EH El 0 nil mi in nni 
Eiimi)> and the practical relevance of the problem is evidenced in the role of 
AdaBoost as learning algorithm in the widespread Viola-Jones object detector 
framework 0 that inherently deals with a clearly asymmetric scenario. 

Nonetheless, the different cost-sensitive AdaBoost methods proposed in the 
literature are very heterogeneous, and they have been presented to the researcher 
as a succession of algorithms with no clear properties to rule their use and 
behavior in practice. 

In the first part of this series of two papers |21j we have presented, in a homo¬ 
geneous notational framework, the different asymmetric AdaBoost approaches 
in the literature, proposing a clustering scheme for them based on the way 
asymmetry is inserted in the learning process (a posteriori, heuristically or the¬ 
oretically): 

• A posteriori 

— AdaBoost with threshold modification 0 

• Heuristic 

— AsymBoost m 

- AdaCost ES] 

- CSBO, CSBI and CSB2 [221E6] 
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AdaCl, AdaC2 and AdaC3 PSIITB] 


• Theoretical 

— Cost-Sensitive AdaBoost [laiin] 

— AdaBoostDB [50] 

— Cost-Generalized AdaBoost m 

Then, for those algorithms with a fully theoretical derivation, we performed 
a thorough theoretical analysis and discussion adopting the two major per¬ 
spectives used to derive and explain AdaBoost: the Error Bound Minimization 
perspective |S] and the Statistical View of Boosting |7] . 

Such analysis demonstrates, from whatever line of reasoning we may fol¬ 
low, that the simple asymmetric weight initialization strategy followed by Cost- 
Generalized AdaBoost, despite having been recurrently overlooked (and even 
rejected) in the literature [151 ESI EZl ESI ESj) is a completely valid mecha¬ 
nism to build theoretically sound cost-sensitive boosted classifiers. Moreover, 
the error bound defined by Cost-Generalized AdaBoost, able to preserve the 
class-dependent loss ratio regardless of the training round, seems to be more 
consistent than that used by the other theoretical alternatives, Cost-Sensitive 
AdaBoost and AdaBoostDB, showing a tendency to increasingly emphasize the 
least costly class {asymmetry swapping). 

The present paper, in order to complete our study, covers the empirical 
analysis of all the methods previously enumerated, including the non-fully- 
theoretical approaches (a posteriori and heuristic) as well as the fully theoretical 
ones. 

The article is organized as follows: next section describes the thorough ex¬ 
perimental framework we used for our experiments, in Section [^ the obtained 
results are detailed, and in Section [^ we analyze and discuss the results con¬ 
necting them to the theoretical insights from the accompanying paper. At last, 
in Section]^ final conclusions are highlighted. 
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2. Experimental Framework 


Aiming to evaluate all the algorithms under the same conditions (train¬ 
ing/test sets, costs) and over a broad range of heterogeneous classification prob¬ 
lems, we designed the following experimental framework: 

2.1. Datasets 

We have used both synthetic and real datasets for our tests. The synthetic 
group is composed of two different (though similar) sets, both conceived to allow 
an easy visual interpretation of the classification task. 

• Bayes Dataset: Positives and negatives are modeled by bivariate normal 
distributions, both with the same priors and covariance matrices, but dif¬ 
ferent means (Figure[^). Features for classification are the projections of 
each sample point on a discrete collection of angles in the 2D space (see 
Figure [^). In this scenario the optimal classifier can be easily computed 
for every cost requirement, according to the Bayes risk rule. 

• Two Clouds Dataset: Inspired by the example in the work by Viola and 
Jones HZl, this dataset can be seen as a more complex version of the Bayes 
Dataset. Positives and negatives are uniformly distributed into two clouds 
(one circular and one annular), with different centers and overlapping each 
other (Figure [^). Features are, again, the projections of each example on 
a discrete range of angles in the 2D space. 

On the other hand, we have used six different datasets extracted from real 
problems. They can be grouped into two classes: 

• UCI Datasets: We have selected five datasets from the UCI Machine 
Learning Repository |24j that are characterized by having an intrinsic 
asymmetric nature: Breast Cancer, Credit, Diabetes, Ionosphere and 
Spam. Examples belonging to the most valuable class of each dataset, 
as defined in the original problem, are considered as positives. 
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(C) 


Figure 1: Synthetic Datasets: (a) Bayes Dataset; (b) weak classifiers on the Bayes Dataset; 

(c) Two Clouds Dataset. Positive examples are marked as while negatives are ‘o’. 

• CBCL Face Database: As an example of a real-world asymmetric problem 
in which boosting is used in practice, we have taken 1000 faces and 1000 
non-faces (19x19 pixels resolution) from the CBCL face database pS] . 
Following the proposal by Viola and Jones [S], we use their same dictionary 
of Haar-like features to build the classifiers. 

For a more homogeneous cost-sensitive benchmark across the different databases, 
we have imposed that the number of positives and the number of negatives 
should match each other in every used dataset. As a result, in UCl datasets, we 
have discarded some examples of the most populated class to match its cardinal¬ 
ity with that of the less populated one. With this condition, we can ensure that, 
regardless the specific problem being tested, the priors of each class are always 
the same (0.5). A summarizing listing of the datasets used for our experiments 
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is shown in Table [T] 


Name 

Pos. 

Neg. 

Feat. 

Short Description 

Bayes 

250 

250 

31 

Two bivariate normal distributions (Figure 

Two Clouds 

500 

500 

31 

Two bivariate clouds with more complex dis¬ 
tributions (Figure pj:) 

UCI Breast 

239 

239 

10 

Classification of benign or malignant breast 
tumors (Original Wisconsin Breast Cancer 
Database) 

UCI Credit 

300 

300 

24 

Set of attributes as good or bad credit risks 

(German Credit Data) 

UCI Diabetes 

268 

268 

8 

Set of attributes as tested positive or not for 

diabetes (Pima Indians Diabetes Database) 

UCI Ionosphere 

126 

126 

34 

Classification of radar returns from the iono¬ 
sphere as good or bad (Johns Hopkins Uni¬ 
versity Ionosphere Database) 

UCI Spam 

1813 

1813 

57 

Classification of email as spam or non-spam 

CBCL 

1000 

1000 

63960 

Classification of face and no-face images us¬ 
ing Haar-like features 


Table 1: Listing of the used datasets, showing the number of positive and negative samples, 
the number of features and a short semantic description of each set. 


2.2. Costs 

In order to sweep a wide range of asymmetries, we have defined nineteen 
different cost combinations to evaluate: 

(Cp, Cn) e {(1,100), (1,50), (1,25), (1,10), (1,7), (1,5), 
(1,3),(1,2),(2,3),(1,1),(3,2),(2,1),(3,1), 

(5,1), (7,1), (10,1), (25,1), (50,1), (100,1)} 

2.3. Algorithms 

For each defined dataset and cost combination, we have trained classifiers 
with all the different algorithms analyzed in this work: AdaBoost with thresh- 
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old modification, AsymBoost, AdaCost, CSBO, CSBl, CSB2, AdaCl, AdaC2, 
AdaC3, Cost-Sensitive AdaBoost/AdaBoostDB and Cost-Generalized AdaBoost. 
In addition, for the Bayes Dataset case, we have the optimal Bayes classifier as 
ground truth reference. 

2.Jf.. Performance Metrics 

The analysis of ROC curves [13 US] has been the traditional way to eval¬ 
uate and compare the behavior of different classifiers across different working 
points. Nevertheless, C. Drummond and R.C. Holte m proposed an alter¬ 
native representation, based on expected costs and dual respect to traditional 
ROC curves, that has been shown to be more appropriate for cost-sensitive clas¬ 
sification problems. Since cost is explicitly shown, this kind of representations 
allow direct visual cost-sensitive interpretations and comparisons, and they are 
based on two magnitudes: the Probability Cost Function (PCF) and the Nor¬ 
malized Expected Cost {NEC), that are defined in Equations Q and (H). In 
these expressions, P{y = I) and P{y = —1) are the prior probabilities of an 
example to be positive or negative, while FNR and FPR are, respectively, the 
false negative and false positive rates obtained by the classifier. 


PCF = 


P{y = i)Cp 

P{y = l)Cp + P{y = -l)CN 


NEC = FNR ■ PCF + FPR ■ (1 - PCF) 


( 1 ) 

( 2 ) 


Our experimental analysis is based on these cost-oriented representations 
m and their related magnitudes. 


2.5. Training and Testing Schemes 

As customary in many boosting works (e.g. 1311110]) weak classifiers used 
in our experiments are the simplest ones, stumps, to further underscore the role 
of “boosting” in getting classification strength by combination. 
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Instead of defining static training and test sets for each database, to further 
improve robustness we have implemented a 3-fold cross-validation strategy: ev¬ 
ery dataset is split into three parts, so the role of test set is iteratively assigned 
to one of the subsets (folds) while the other two define the respective training 
set. From the three possible training scenarios arising from this scheme, three 
different classifiers are obtained, and the global performance will be defined as 
the average of the individual performances obtained over the respective test 
sets. 

Whichever fold, cost requirement, database or learning algorithm involved, 
every training process has been run for as many boosting rounds as the total 
number of examples (positives and negatives) of the respective dataset. In any 
case, to evaluate the performance of the different algorithms in a more uniform 
way throughout the different databases and costs, we have also performed an 
“a posteriori” convergence test. A classifier initially trained for K rounds is 
considered to converge at round k < K li the next two conditions are met: 

• The deviation about the mean of the Normalized Expected Cost (NEC) 
over the training set is less than 10“^, for all the subsequent rounds {k -\- 
l,k + 2,---K). 

• The subsequent rounds are, at least 10% of the total {K — k > O.IK). 

To extract our experimental results, the earliest round meeting these two 
conditions is used as cutoff of the classifier. Otherwise, in case no converging 
round has been found, the entire classifier is taken into account. This procedure 
is aimed to protect the results from overfitting artifacts that could degrade some 
comparative experiments. 

Depending on the specific scenario, there are several exceptions to this frame¬ 
work: 

• Bayes theoretical classifier (only for the Bayes dataset) is optimal by def¬ 
inition, thus it is “only one” and requires no training. In this case cross- 
validation makes no sense and the classifier is directly tested over the 



whole database. 


• For AdaBoost with threshold modification we have used the whole training 
dataset both to train the strong classifier and to adjust its threshold, in¬ 
stead of having, as originally proposed by Viola and Jones [S], independent 
sets for each role. From our point of view this is the most appropriate and 
homogeneous way to compare this method with the other ones, since the 
“threshold adjustment” dataset is no more than an additional training set. 
It is not clear for us how to properly establish a boundary to distribute, 
with the right sizing, the training examples into two independent and 
smaller subsets, as well as how this split affects the overall performance. 

• On AsymBoost classifiers, the convergence test is not performed. The 
definition of the algorithm (see the previous paper of the series m) states 
that the number of training rounds determines how the asymmetry is 
introduced and distributed in the classifier. As a consequence, pruning 
the number of rounds of the final classifier would violate the asymmetric 
premises on which training was defined, changing the error metric that 
has actually been minimized. 

3. Results 

Following the guidelines presented in the previous subsection, we have trained 
all the combinations of algorithm, database, costs and fold to obtain a broad 
collection of classifiers. The individual performance of each classifier has been 
evaluated over its respective test dataset, and finally averaged across the cross- 
validation folds for each case. As a result of this process we obtained a large 
corpus of performance data that can be consulted in detail in Appendix. 

Tabled summarizes the abbreviations we have used to refer to the different 
algorithms in the forthcoming tables and figures of this section and Appendix. 
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Algorithm 

Abbreviation 

AdaBoost with threshold modification 

ABT 

AsymBoost 

ASB 

AdaCost 

ADC 

CSBO 

CBO 

CSBl 

CBl 

CSB2 

CB2 

AdaCl 

ACl 

AdaC2 

AC2 

AdaC3 

ACS 

Cost-Sensitive AdaBoost / AdaBoostDB 

CSA 

Cost-Generalized Adaboost 

CGA 

Optimal Bayes (for Bayes Dataset) 

BAY 


Table 2: Abbreviations used to refer to the tested algorithms in forthcoming figures and tables. 


3.1. Global Analysis 

To make a global behavioral analysis of the classifiers obtained by each algo¬ 
rithm, we have defined a comparative performance measure based on Normalized 
Expected Costs {NEC) [27] . For each combination of dataset and cost require¬ 
ment we found which of the trained classifiers had a lowest NEC, and then 
computed the deviations between the NEC values obtained by all classifiers 
and that minimum one. These deviation values, which we denote as ANEC, 
measure the distance of each classifier to the best solution we have achieved for 
the same scenario. Repeating this process across databases and costs to gather 
all the ANEC values corresponding to the whole experimental framework, we 
will obtain a wide sample of a random variable ranking the performance of the 
trained classifiers. 


AN EC {alg, cost, set) = NEC{alg, cost, set) — argmin {N EC {alg, cost, set)) 

alg 

(3) 

As can be seen in Equation ([^, ANEC is a function of three variables: 
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learning algorithm (alg), cost requirement (cost) and dataset Thus, if 

we compute the conditional expectation of ANEC for a given algorithm A Q, 
we will obtain the overall ranking score of all the classifiers trained by that 
specific algorithm throughout the whole experimental framework. Figure |2a| 
and Table 1^ depict the obtained values of E[AfVillC'(A)] for all the algorithms 
we are studying. 


E[AiVi?(7(A)] = F,[ANEC{alg, cost, set)\alg = A] (4) 



(a) (b) 


Figure 2: Global Conditional Expectations (a) and Variances (b) of ANEC for each tested 
algorithm. 

Bearing in mind that the lower E[ANEC], the better the performance, 
AdaCl (one of the heuristic alternatives) is the algorithm showing best global 
results, followed by Cost-Generalized AdaBoost (one of the theoretical variants). 
After them, in a second tier, we find AsymBoost (heuristic), CSBO (heuristic) 
and AdaBoost with threshold modification (a posteriori). On the opposite side, 
AdaCost (heuristic) is, by far, the algorithm showing the worst performance 
results. 

To analyze the stability (defined as the statistical precision) of these ranking 
scores across databases and costs, we have also computed the conditional vari¬ 
ance of ANEC for each algorithm ([^, obtaining the results shown in Eigure p^ 
and second column of Table As can be seen, AdaCl and Cost-Generalized 


^Note that fold averaging was done in a previous step. 


11 













E[AiVEC(A)] 

Var(AAfEC(A)) 

ABT 

5.273-10-2 

3.136-10-2 

ASB 

3.993-10-2 

1.387-10-2 

ADC 

2.272-10-1 

8.510-10-2 

CBO 

5.142-10-2 

4.845-10-2 

CBl 

7.891-10-2 

1.012-10-2 

CB2 

6.810-10-2 

7.782-10-2 

ACl 

1.399-10-2 

3.681-10-1 

AC2 

7.071-10-2 

8.403-10-2 

AC3 

7.350-10-2 

9.399-10-2 

CSA 

7.247-10-2 

4.226-10-2 

CGA 

2.343-10-2 

5.935-10-1 


Table 3: Global Conditional Expectation and Variance values of ANEC for each tested 
algorithm. 


AdaBoost are not only the algorithms giving the best average performance, they 
also are the most stable ones, with a difference of about one order of magnitude 
to the next. 


Vai{ANEC{X)) =VaT{ANEC{alg,cost,set)\alg = X) (5) 

Going into a little more detail, if we inspect figures in Appendix, we will 
see that, for increasing asymmetries, several algorithms have a tendency to 
“saturate” and build “all-positives” or “all-negatives” solutions, instead of clas¬ 
sifiers that, though biased to the most costly class, can still distinguish between 
two different labels. In order to globally evaluate and quantify this effect, we 
have dehned the parameter ACE ([^, analogous to ANEC but based on cost- 
insensitive Classification Error (CE, the ratio of correctly classihed instances in 
the whole database), as a measure of the discriminative power of each obtained 
classifier with respect to the best distinguishing one for its same scenario. By 
definition, algorithms with a lower discriminative power (higher ACE) are more 
prone to saturation. 
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ACE{alg, cost, set) = CE(alg, cost, set) — argmin [CE[alg, cost, set)) (6) 

alg 

Values of conditional expectation and variance of ACE for each tested al¬ 
gorithm are shown in Figure and Table As can be seen, AdaBoost with 
threshold modification (a posteriori), Cost-Sensitive AdaBoost (theoretical) and 
AsymBoost (heuristic) are, in that order, the best discriminating algorithms, 
and also the most stable ones in this regard. After them, the two algorithms 
that showed better general performance are just the next in the ranking, but 
this time in reverse order: Cost-Generalized AdaBoost is more discriminative 
than AdaCl and also more stable. The remaining algorithms present much 
poorer discrimination results. 



ABT ASB ADC CBO CB1 CB2 AC1 AC2 ACS CSA CGA ABT ASB ADC CBO CB1 CB2 AC1 AC2 ACS CSA CGA 


(a) (b) 

Figure 3: Global Conditional Expectations (a) and Variances (b) of ACE for each tested 
algorithm. 


The analysis of the discriminant power is relevant because saturation may 
prevent a proper boosted evolution during learning, and cause a detrimental 
effect to the global performance of the final classifier. It is important to notice 
that the best classifier that a learning algorithm can build, no matter the specific 
cost scenario, is a classifier with null error. Such an ideal classifier must achieve 
null error in positives and in negatives, being, in fact, symmetric. Hence, an ideal 
cost-sensitive boosting algorithm should be aimed to approach that perfect (and 
symmetric) classifier as much as possible, but following a consistent cost-sensitive 
iterative pathway. Thus, during learning, cost-sensitive boosting algorithms 
must keep a balance between the global asymmetry reached after each round, 
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E[ACE(A)] 

Var(ACE(A)) 

ABT 

1.861-10-2 

6.292-10-1 

ASB 

2.002-10-2 

8.651-10-1 

ADC 

1.813-10-1 

1.482-10-2 

CBO 

2.212-10-1 

1.076-10-2 

CBl 

3.203-10-1 

1.361-10-2 

CB2 

3.087-10-1 

1.592-10-2 

ACl 

5.056-10-2 

5.576-10-3 

AC 2 

2.998-10-1 

1.564-10-2 

ACS 

2.990-10-1 

1.797-10-2 

CSA 

1.965-10-2 

9.236-10-1 

CGA 

3.247-10-2 

1.554-10-3 


Table 4: Global Conditional Expectation and Variance values of ACE for each tested algo¬ 
rithm. 


and the ability to evolve and further approximate the ideal solution in the 
forthcoming ones. In this scenario, the saturation effect may act as an anchor 
of the asymmetry and preclude a proper boosted evolution towards a classifier 
closest to the ideal one. We will discuss this in depth in Section [4d| 

3.2. Cost Analysis 

Once we have made a general analysis on the global behavior of all the 
asymmetric AdaBoost variants we are testing, now it is time for a more de¬ 
tailed study able to asses the specific behavior of the algorithms through the 
cost spectrum. For a clearer analysis, we will prune the total set of algorithms 
to focus our attention on those yielding most interesting overall results accord¬ 
ing to the data presented in the previous subsection: on the one hand, AdaCl, 
Cost-Generalized AdaBoost and AsymBoost (the top three algorithms with low¬ 
est ANEC{X))-, and, on the other hand, AdaBoost with threshold modification 
and Cost-Sensitive AdaBoost (among the remaining, those with less tendency 
to saturation). As can be seen, this selection includes algorithms from all the 
three types in which we clustered all the cost-sensitive AdaBoost variants in the 
previous paper of the series |21] : A posteriori (AdaBoost with threshold mod¬ 
ification), Heuristic (AsymBoost and AdaCl) and Theoretical (Cost-Sensitive 
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AdaBoost and Cost-Generalized AdaBoost). 

Now we are interested in computing the conditional expectation and variance 
of ANEC for each particular algorithm A and cost combination r, as shown in 
Equations Q and Thus, we can obtain the cost-dependent ranking scores 
for all the algorithms we are studying, as shown in Figure]^ As can be seen, 
AdaCl outperforms (both in performance and stability) the other alternatives in 
virtually all the tested cost scenarios, being closely followed by Cost-Generalized 
AdaBoost, while the results yielded by the other tested variants are clearly 
worse. It is remarkable that differences among the different algorithms tend to 
be more significant for increasing asymmetries (high values of \PCF\), while for 
moderate ones differences are more negligible. 


E[AA^ifC'(A, t)] = Fj[ANEC{alg, cost, set)\alg = A, cost = r] (7) 
Var(AAifC'(A, r)) =YaT{ANEC{alg,cost,set)\alg = X,cost = t) (8) 



Figure 4: Cost-Dependent Conditional Expectations (a) and Variances (b) of ANEC for each 
tested algorithm. 

An analogous procedure is followed to compute the cost-dependent discrim¬ 
inative power {ACE(X,t)), whose expectation and variance are depicted in 
Figure Differences are again concentrated in high asymmetries, but this time 
with flipped roles: the two algorithms with better general performance are now 
the ones showing less discriminative power, which is especially noticeable for 
AdaCl. 
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Figure 5: Cost-Dependent Conditional Expectations (a) and Variances (b) of ACE for each 
tested algorithm. 

3.3. Training Time 

Another important aspect to consider when analyzing our experimental re¬ 
sults is the computational burden associated to the training phase, especially 
bearing in mind that this kind of algorithms is widely used in learning systems 
dealing with a huge number of training samples and an even greater number of 
features (object detection in images, as the algorithm proposed by Viola and 
Jones [9], is a paradigmatic example), in which training can be extremely long. 
Training times obtained for each algorithm and dataset, averaged over the three 
folds, are shown in Table 

For an easier interpretation of these results, we have taken Cost-Generalized 
AdaBoost (the fully-theoretical alternative with a lower training time and also 
the reference used in Figures in Appendix) as a basis. Thus, we computed, for 
every dataset, the time consumed by each algorithm in relation to that needed 
by Cost-Generalized AdaBoost, and finally averaged the obtained ratios across 
datasets. Results are depicted in Table 

As can be seen, most of the algorithms are in a ±7% range with regard to 
Cost-Generalized AdaBoost. However, there are two algorithms whose training 
times are much greater than the rest: AdaBoost with threshold modification 
(2.25 times slower than Gost-Generalized AdaBoost), due to the extra time 
needed to adjust the threshold after each iteration; and, above all, Gost-Sensitive 
AdaBoost (18 times slower than Cost-Generalized AdaBoost) that is, by far, the 
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Bayes 

Two Clouds 

Breast 

Credit 

ABT 

1.413 

4.966 

9.100-10-1 

1.404 

ASB 

6.485-10-1 

2.552 

2.451-10-1 

5.912-10-1 

ADC 

6.192-10-1 

2.076 

2.688-10-1 

5.473-10-1 

CBO 

6.216-10-1 

2.636 

2.569-10-1 

5.806-10-1 

CBl 

6.507-10-1 

2.666 

2.613-10-1 

5.715-10-1 

CB2 

6.663-10-1 

2.576 

2.584-10-1 

5.863-10-1 

ACl 

7.065-10-1 

2.716 

2.807-10-1 

6.304-10-1 

AC2 

6.407-10-1 

2.636 

2.583-10-1 

5.835-10-1 

ACS 

6.425-10-1 

2.699 

2.625-10-1 

6.029-10-1 

CSA 

1.612-101 

4.708-101 

3.178 

2.305 

CGA 

6.700-10-1 

2.695 

2.527-10-1 

5.840-10-1 


Diabetes 

Ionosphere 

Spam 

CBCL 

ABT 

1.014 

5.868-10-1 

3.551-101 

1.063-10-1 

ASB 

3.032-10-1 

2.716-10-1 

2.528-101 

1.063-101 

ADC 

2.715-10-1 

2.637-10-1 

2.040-101 

1.084-101 

CBO 

2.844-10-1 

2.645-10-1 

2.543-101 

1.090-101 

CBl 

2.982-10-1 

2.788-10-1 

2.571-101 

1.065-101 

CB2 

2.972-10-1 

2.798-10-1 

2.569-101 

1.068-101 

ACl 

3.082-10-1 

2.828-10-1 

2.782-101 

1.162-101 

AC2 

2.731-10-1 

2.737-10-1 

2.715-101 

1.172-101 

ACS 

2.741-10-1 

2.687-10-1 

2.822-101 

1.282-101 

CSA 

2.692 

2.395 

1.115-102 

6.737-10® 

CGA 

2.928-10-1 

2.699-10-1 

2.523-101 

1.065-101 


Table 5: Training time (s) 




Time Ratio 

ABT 

2.250 

ASB 

0.992 

ADC 

0.928 

CBO 

0.987 

CBl 

1.005 

CB2 

1.006 

ACl 

1.068 

AC2 

1.010 

ACS 

1.036 

CSA 

17.973 


Table 6: Average training time ratio needed by the tested algorithms compared to that con¬ 
sumed by Cost-Generalized AdaBoost. 


most complex algorithm we are testing. At this point we must remember that, 
though Cost-Sensitive AdaBoost and AdaBoostDB have been shown to reach 
the same solutions and their classification performance can be analyzed as if 
they were only one variant, their training times are markedly different. For 
feasibility, in our experimental framework, we have used AdaBoostDB, which, 
as reported in [5D], is more than 200 times faster than Cost-Sensitive AdaBoost. 
Hence, AdaBoostDB is the algorithm that actually needs 18 times the training 
time consumed by Cost-Generalized AdaBoost, while Cost-Sensitive AdaBoost 
would be even far slower. 


4. Discussion 

We will now discuss the obtained results we have just shown to gain insights 
on the empirical behavior of the different algorithms. 

4-.1. Saturation and Poor Performance 

In Section [TT] we coined the concept “saturation” as the tendency of a learn¬ 
ing algorithm to get “all-positives” or “all-negatives” classifiers when trained for 
increasing asymmetries, and defined an empirical measure (ACE) of the ten¬ 
dency to saturation in terms of the discriminative power of the classifiers learned 
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by a given algorithm. We also argued that, since the ideal classiher for any cost 
scenario is that obtaining null error in positives and in negatives (thus, a sym¬ 
metric decision), saturation may be a detrimental effect precluding a proper 
approximation to that ideal classifier during the boosted learning process. 

As we can see in Figure]^ and Tablefive of the tested algorithms have an 
average discrimination power markedly lower than the remaining ones. These 
algorithms are CSBO, CSBl, CSB2, AdaC2, AdaC3 and AdaCost, and they are 
among the eight algorithms yielding poorest overall results in our experiments 
(Figure and Table [^. By inspecting figures in Appendix the tendency to satu¬ 
ration of these six algorithms becomes evident, empirically revealing the seeming 
correlation between tendency to saturation and bad performance results. 

The listed algorithms have something in common, all of them are heuristic 
approaches based on direct manipulations of the weight update rule. Moreover 
CSBO, CSBl, CSB2, AdaC2 and AdaC3 have an unique feature that none of the 
other tested algorithms present: they are the only alternatives including costs 
as a multiplicative factor in their respective weight update rules. This multi¬ 
plicative mechanism is one of the most aggressive forms of inducing asymmetry 
in the boosting process, to the extent that, in view of the obtained results, it 
leads to a selection of weak classifiers that is systematically anchored to the 
costly class, thus avoiding a normal boosted evolution and building saturated 
strong classihers. 

Though also heuristic, AdaCost is a different case. Curiously (see Appendix), 
while for the Bayes dataset and almost all cost combinations in UCI Breast 
Cancer dataset AdaCost is able to obtain the best results, for the remaining 
datasets its performance is so poor that it even yields error rates greater than 
0.5! As a consequence, AdaCost presents the worst overall performance, by far, 
of all the algorithms we have tested (see Figure and Table [^. 

Revising AdaCost formulation, we can see that while weak classiher selection 
is made accordingly to the weight distribution D{i), the goodness parameter at 
related to that selection depends on the weight distribution but also on the cost- 
adjustment function /3(z). Thus, weak classihers selection is guided by a criterion 
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different to that of goodness computation and weight update, giving rise to some 
degree of decoupling in the process. In an extreme case, this decoupling may 
cause the at of the selected classifier to be negative, so the contribution of this 
classifier to the ensemble will also be negative (its reversed version, with swapped 
labels, will be, in fact, “better” than the selected one). This kind of situation 
was already pointed out by the authors of the algorithm m, suggesting sign 
reversal as an a posteriori possible solution), and is responsible for the error 
rates exceeding 0.5. 

4-2. AdaBoost with Threshold Modification and AsymBoost 

AdaBoost with threshold modification and AsymBoost, the two cost-sensitive 
heuristic approaches proposed by Viola and Jones min], take a step further 
in performance and also seem to be immune to saturation. Their results are 
significantly worse than those obtained by AdaCl and Cost-Generalized Ada¬ 
Boost, but despite of being heuristic modifications, AsymBoost and AdaBoost 
with threshold modification yield better results than Cost-Sensitive AdaBoost, 
one of the theoretically based approaches. 

In addition to its lower performance compared to other tested alternatives, 
these two algorithms have other practical drawbacks: on the one hand, Ada¬ 
Boost with threshold modification requires the definition of two training sets, 
one for symmetric learning and another one for threshold adjustment; on the 
other hand Asymboost needs to predefine a fixed number of training rounds to 
keep the desired asymmetric goal, resulting in a significant lack of flexibility 
(on-the-fly performance tests to stop training must be disabled, and boosted 
classifiers already learned can not be trimmed). 

4-3. The Theoretical Approaches under an Empirical Perspective 

In the previous paper of the series |21j we performed a thorough analy¬ 
sis on the theoretical cost-sensitive AdaBoost variants proposed in the litera¬ 
ture, showing that Cost-Sensitive Adaboost/AdaBoostDB and Cost-Generalized 
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AdaBoost drive to different solutions. Now, our empirical results not only cor¬ 
roborate that the obtained classifiers for those algorithms are different, but also 
that Cost-Generalized AdaBoost outperforms Cost-Sensitive AdaBoost in all 
the scenarios (FigureTableand Appendix), with a difference that is more 
marked the greater the asymmetry (Figure]^. Our experiments also show that 
both proposals seem to be immune to saturation (Figure and Table |^, and 
that differences in training time (complexity of the algorithms) are vast: Cost- 
Generalized AdaBoost is 18 times faster than AdaBoostDB, which, in turn, has 
been shown to be more than 200 times faster than Cost-Sensitive AdaBoost [20] . 

Another result drawn from our theoretical analysis is that, as Cost-Sensitive 
Boosting training progresses, the ratio between positive and negative losses 
tends to decrease, to the extent that class prevalence may end up being in¬ 
verted (see the accompanying paper [21]). Meanwhile, the loss ratio for Cost- 
Generalized AdaBoost remains constant under the same circumstances through¬ 
out the whole training process. To visualize and assess this behavior in practice, 
we have defined the Classification Asymmetry {CA) of a given classifier (over 
its respective test set) as the ratio of correct decisions on positives (true positive 
rate, TPR) to all the correct decisions made by the classifieij^ (true positive and 
true negative rates, TPR + TNR). 


^ , TPR 1 - FPR 

(jA — _ _ _ 

TPR + TNR (1 - FPR) -k (1 - FNR) 

Classification asymmetry is, in fact, a measure on how well the classifier is 
performing in one class with regard to the other one: A value of 0.5 means a 
balanced behavior, a value greater than 0.5 means that positives tend to be bet¬ 
ter classified than negatives, and a value lower than 0.5 means that negatives 
are better classified than positives. At this point is important to remember 
that, as commented in Sectionfor whatever cost scenario, the ideal classifier 


^This definition of Classification Asymmetry is only valid for balanced test sets, as those 
in our experimental framework 
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is that making no mistakes in any of the two classes, and such a classifier has a 
classification asymmetry of 0.5 (it is symmetric). Thus, from an iterative per¬ 
spective, the classification asymmetry obtained by any cost-sensitive boosting 
learning scheme should favor the costly class from the beginning, but vanish 
as the process progresses and the strong classifier evolves to approach the ideal 
one. 

Hence, on the one hand, we have a parameter (the classification asymmetry) 
that, though biased towards the costly class, should evolve to a more balanced 
value during boosting learning. On the other hand, we have one algorithm, Cost- 
Sensitive Boosting, whose loss ratio changes during the learning process to the 
extent that the role of costly class may be swapped (see the theoretical analysis 
in the companion paper of the series [H]). How are these effects reflected in 
practice? 

Following our experimental framework, we have gathered the values of Classi¬ 
fication Asymmetry obtained by Cost-Sensitive AdaBoost and Cost-Generalized 
AdaBoost after every training round of every dataset and fold, and for every cost 
combination. For an easier interpretation, we plotted 3D graphs condensing the 
obtained data for each dataset and algorithm at a glance, as those shown in Fig¬ 
ure]^ In these examples we can see, as expected, that classification asymmetry 
starts biased towards the costly class, and then progressively tends to vanish. 
But Figure also makes empirically explicit the other effect we talked about: 
for Cost-Sensitive Boosting, classification asymmetry ends up being swapped, 
reaching final classifiers with an asymmetry opposite to that originally intended. 

While asymmetry vanishing is a normal trend, it is straightforward to under¬ 
stand that swapping is an undesirable effect for a cost-sensitive boosted classifier, 
and it may be responsible for the performance decrease shown by Cost-Sensitive 
AdaBoost. 

To build Figure]^ we selected those scenarios from our experimental frame¬ 
work in which asymmetry swapping is more evident. In the remaining examples 
swapping is more subtle, though it is still probably a detrimental factor on the 
overall performance yielded by Cost-Sensitive AdaBoost. It is also important to 
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Figure 6: Classification asymmetry comparative between Cost-Generalized AdaBoost and 
Cost-Sensitive AdaBoost, across training rounds and costs, for Bayes, UCI Ionosphere and 
CBCL datasets. 

bear in mind that asymmetry swapping should be stronger the closer to over¬ 
fitting the classifier is and, as explained in Section our experimental data 
was gathered following a framework in which the risk of overfitting is highly 
controlled. 

4.4- Comparison of the Two Best Solutions 

As a result of our empirical analysis, two algorithms stand above the rest: 
AdaCl and Cost-Generalized AdaBoost, with performance figures that are con¬ 
sistently better than those shown by the other alternatives in virtually all the 
tested scenarios. Of these two algorithms, AdaCl presents an overall perfor- 
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mance slightly higher than Cost-Generalized AdaBoost (Figure]^ and Table [^, 
that is kept across all the tested costs (Figure]^. 

From a theoretical point of view, bearing in mind that AcaCl is an algo¬ 
rithm of a heuristic nature while Cost-Generalized AdaBoost has an entirely 
theoretical derivation behind, we could expect that the latter would provide 
better results than the former. What is happening? Where is the supposed 
“theoretical advantage” of Cost-Generalized AdaBoost? 

Inspecting Figure and Table we can appreciate that both algorithms are 
far from those experimenting saturation problems, but, in comparative terms. 
Cost-Generalized AdaBoost has a higher and much more stable discriminative 
power than AdaCl. In fact, if we analyze ACE across costs (see Figure]^ we 
will appreciate that, though for moderate asymmetries AdaCl is slightly more 
discriminative than Cost-Generalized AdaBoost, for high asymmetries the dis¬ 
criminative power of AdaCl is signihcantly lower than that of Cost-Generalized 
AdaBoost. This behavior seems to suggest that AdaCl applies asymmetry more 
strongly. 

If we return to the algorithmic dehnition of AdaCl (see the accompanying 
paper [H]), we can see that the error measurement used to select the weak 
classiher at each iteration incorporates both the current weight distribution and 
the cost associated to each example of the training dataset. The goodness pa¬ 
rameter at related to the selected classiher is computed from that same error 
measurement, and weights are then updated by exponential factors depending 
on at and on the costs associated to each training example. This scheme im¬ 
plies that costs are actually included twice in the weight update rule of AdaCl: 
once through at (that depends on the error measurement which, in turn, de¬ 
pends on costs) and again through the direct incorporation of the costs to the 
exponential. Instead, the weight update rule in Cost-Generalized AdaBoost em¬ 
beds asymmetry only through the at parameter. This “two-way” asymmetry 
embedding in the weight update of AdaGl is the reason why it has a stronger 
cost-sensitive behavior than Cost-Generalized AdaBoost, and the core of the 
difference between the two algorithms. 
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After the empirical results we are showing, it seems difficult to find the sup¬ 
posed advantage of using Cost-Generalized AdaBoost with regard to AdaCl, due 
to the formal guarantees (intact compared to classical AdaBoost) of the former. 
As commented before, both algorithms are, undoubtedly, the two algorithms 
showing best performance, but AdaCl gets results slightly better than Cost- 
Generalized AdaBoost after a broad empirical analysis. However, there is one 
scenario of our experimental framework in which Cost-Generalized AdaBoost 
seems to outperform AdaCl: the CBCL database (see Appendix, particularly. 
Figure A-8). Performing the “Classification Asymmetry” analysis proposed in 
the previous subsection we obtained the 3D graphs depicted in Figure As 
can be seen, similarly to Cost-Sensitive AdaBoost, AdaCl seems to suffer from 
some kind of asymmetry swapping at medium to high costs, obtaining classifiers 
with an asymmetry reversed to that desired. 



(a) (b) 

Figure 7: Classification asymmetry comparative between Cost-Generalized AdaBoost and 
AdaCl, across training rounds and costs, for the CBCL dataset. 

The key to this problem may be in the loss functions somehow defined by the 
heuristic modifications inside AdaCl. The ratio between the positive and neg¬ 
ative losses may be changing throughout the iterative learning process, leading, 
at some point, to a class prevalence change, similarly to Cost-Sensitive Ada¬ 
Boost (but, probably, in a more moderate way). It is important to remember 
again that asymmetry swapping tends to be more detrimental the closer the 
obtained classifier is to overfitting, which will depend on several parameters, 
like the complexity of the problem, the complexity of the weak hypothesis, the 
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number of training rounds or the number of training samples. In fact, CBCL is, 
by far, the most complex problem in our experimental framework: the one with 
most training samples, the one with a largest pool of weak classifiers and the one 
needing more boosting training rounds to reach its goals. In such conditions, 
Cost-Generalized AdaBoost remains totally immune to asymmetry swapping 
and other detrimental effects, showing us that its stability and versatility, are 
the real advantage of its full theoretical derivation and the associated formal 
guarantees, inherited from standard classical AdaBoost. 

5. Conclusions 

In this series of two papers we have performed, both theoretically (Part 
I) and practically (Part II), a thorough analysis on the different cost-sensitive 
variants of AdaBoost proposed in the literature, in order to provide a unifying 
framework for their definition, classification, comparison and assessment. 

In Part I |2I| . after presenting, in a homogeneous framework, the bunch 
of algorithms of interest (AdaBoost with threshold modification [5]; Asym- 
Boost [13; AdaCost [15]; CSBO, CSBl and CSB2 [32[T2]; AdaCl, AdaC2 and 
AdaCS [23l|T8|; Cost-Sensitive AdaBoost [12[ID]; AdaBoostDB [20|; and Cost- 
Generalized AdaBoost m) we proposed a clustering scheme to group them 
depending on the way asymmetry is inserted in the learning process {theoreti¬ 
cally, heuristically or a posteriori), and performed a deep theoretical analysis 
of those methods with a full theoretical derivation (Cost-Sensitive AdaBoost, 
AdaBoostDB and Cost-Generalized AdaBoost). Such analysis revealed that the 
asymmetric weight initialization giving rise to Cost-Generalized AdaBoost, the 
simplest mechanism of all (disregarded in many previous works), was shown 
to provide the most consistent error bound definition, being able to preserve 
the class-dependent loss ratio regardless of the training round, whereas Cost- 
Sensitive AdaBoost/AdaBoostDB seem to emphasize the least costly class as 
training progresses {asymmetry swapping effect). 

The present paper has covered the experimental part of our work, showing 
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a detailed analysis of the behavior of all the algorithms under study (fully- 
theoretical or not) over a large range of classification problems. The obtained 
results confirm that Cost-Sensitive AdaBoost and AdaBoostDB suffer, in prac¬ 
tice, from the asymmetry swapping effect disclosed on Part I of our work and 
are clearly outperformed by Cost-Generalized AdaBoost in all the scenarios. On 
the other hand, most of the heuristic algorithms have very low performance and 
are prone to obtain saturated classifiers (“all-positives” or “all-negatives”). 

There are two algorithms that stand above the rest after our empirical anal¬ 
ysis: AdaCl (heuristic) and Cost-Generalized AdaBoost (theoretical). How¬ 
ever, despite AdaGl’s overall performance is slightly better than that of Gost- 
Generalized Adaboost, our tests suggest that the former potentially suffers from 
asymmetry swapping, which can be a side effect of the heuristic definition of 
the algorithm. 

Hence, from a theoretical, practical or even algorithmic perspective, our uni¬ 
fying analysis points to Gost-Generalized AdaBoost as the best and also simplest 
option to provide AdaBoost with cost-sensitive sound capabilities, preserving all 
the formal guarantees from the classical (cost-insensitive) version of AdaBoost 
and exactly its same computational burden. 
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Appendix A Detailed Experimental Results 


Detailed results obtained by our experimental framework are shown in the 
following tables and figures. 
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Table A-1 - Continued on next page 
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ABT 

10-1 
8.4S - 

IQ-^ 

8.OS - 

10-^ 
8.2S • 

10-^ 

8.17 • 


ASB 

10“^ 
8.4S - 

10“^ 
6.4S • 

10“^ 
7.4S • 

IQ-^ 
6.9S - 


ASB 

10-^ 

8.OS - 

IQ-^ 
6.4S - 

10-^ 
7.2S • 

10-^ 

6.96 • 


ADC 

10“^ 
1.49 - 

10“^ 
2.81 • 

10“^ 
8.84 • 

IQ-^ 
5.82 - 


ADC 

10-^ 
1.04 - 

IQ-^ 
4.82 - 

10-^ 
7.6S • 

10-^ 

6.69 • 


CBO 

10“1 
S.61 - 

10“^ 

8.OS • 

10“^ 
1.85 • 

IQ-^ 
9.64 - 


CBO 

10-1 
S.61 - 

IQ-^ 

8.OS - 

10-^ 
1.85 • 

10-^ 

1.26 • 


CBl 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

IQ-^ 
2.50 - 


CBl 

10-1 

1.000 

IQ-^ 

0.000 

10-1 
5.00 • 

10-1 
s.ss • 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10-1 
2.50 - 


CB2 

9.76 - 

0.000 

10-1 
4.88 • 

10-1 

S.25 • 


ACl 

7.2S - 

6.02 • 

10“1 
6.6S • 

10-1 
6.SS - 


ACl 

10-1 
7.6S - 

6.8S - 

10-1 
7.2S • 

10-1 

7.10 • 


AC2 

10“^ 
7.91 - 

10“^ 

8.OS • 

10“^ 
4.00 • 

IQ-^ 
2.04 - 


AC2 

10-^ 
4.66 - 

IQ-^ 
4.02 - 

10-^ 
2.S5 • 

10-^ 

1.58 • 


ACS 

10“1 
4.22 - 

10“^ 
4.02 • 

10-1 

2.IS • 

10-1 
1.08 - 


ACS 

10-1 
6.S9 - 

IQ-^ 
4.02 - 

10-1 

S.21 

10-1 

2.16 • 


CSA 

10“^ 
6.4S - 

10“^ 
7.2S • 

10“1 
6.8S • 

10-1 

7.OS - 


CSA 

10-1 
7.2S - 

IQ-^ 
7.6S - 

10-1 
7.4S • 

10-1 

7.50 • 


CGA 

10“^ 
9.64 - 

10“^ 
5.62 • 

10“^ 
7.6S • 

IQ-^ 
6.6S - 


CGA 

10-^ 

8.OS - 

IQ-^ 
6.8S - 

10-^ 

7.4S • 

10-^ 

7.2S • 



10“^ 

10“^ 

10“^ 

IQ-^ 



10-^ 

IQ-^ 

10-^ 

10-^ 

[2,3] 

BAY 

9.20 - 

S.60 • 

6.40 • 

5.84 - 

[1. 1] 

BAY 

6.80 - 

5.60 - 

6.20 • 

6.20 • 


ABT 

10“^ 
8.4S - 

10“^ 

8.OS • 

10“^ 
8.2S • 

IQ-^ 
8.19 - 


ABT 

10-^ 
8.4S - 

IQ-^ 
7.6S - 

IQ-^ 

8.OS • 

10-^ 

8.OS • 


ASB 

10“^ 
8.4S - 

10“^ 
7.2S • 

10“^ 
7.8S • 

IQ-^ 

7.71 - 


ASB 

10-^ 
8.4S - 

IQ-^ 
7.6S - 

10-^ 

8.OS • 

10-^ 

8.OS • 


ADC 

10“^ 
9.24 - 

10“^ 
4.82 • 

10“^ 

7.OS • 

IQ-^ 
6.59 - 


ADC 

10-^ 
5.62 - 

IQ-^ 
7.6S - 

10-^ 
6.6S • 

10-^ 

6.6S • 


CBO 

10“^ 
S.61 - 

10“^ 

8.OS • 

10“^ 
1.85 • 

IQ-^ 
1.49 - 


CBO 

10-^ 
5.62 - 

IQ-^ 
7.6S - 

10-^ 
6.6S • 

10-^ 

6.6S • 


CBl 

10“1 
9.56 - 

10“^ 

0.000 

10-1 
4.78 • 

10-1 
S.82 - 


CBl 

10-^ 

8.OS - 

IQ-^ 
5.22 - 

10-^ 
6.6S • 

10-^ 

6.6S • 


CB2 

10“^ 
8.S5 - 

0.000 

10-1 
4.18 • 

10-1 
S.S4 - 


CB2 

10-^ 
8.4S - 

IQ-^ 
7.6S - 

10-^ 

8.OS • 

10-^ 

8.OS • 


ACl 

10“1 

8.OS - 

6.8S • 

10-1 
7.4S • 

10-1 

7.SI - 


ACl 

10-^ 
8.4S - 

IQ-^ 
6.02 - 

10-^ 
7.2S • 

10-^ 

7.2S • 


AC2 

10“^ 
6.4S - 

10“^ 
4.02 • 

IQ-^ 
S.2S • 

IQ-^ 
2.59 - 


AC2 

10-^ 
8.4S - 

IQ-^ 
7.6S - 

10-^ 

8.OS • 

10-^ 

8.OS • 


ACS 

10“1 
7.19 - 

10“^ 
4.02 • 

10-1 
S.61 • 

10-1 
2.90 - 


ACS 

10-^ 
8.4S - 

IQ-^ 
6.02 - 

10-^ 
7.2S • 

10-^ 

7.2S • 


CSA 

10“^ 
6.8S - 

10“^ 
6.8S • 

10-1 
6.8S • 

10-1 
6.8S - 


CSA 

10-^ 
8.4S - 

IQ-^ 
7.6S - 

10-^ 

8.OS • 

10-^ 

8.OS • 


CGA 

10“^ 

8.OS - 

10“^ 
7.2S • 

IQ-^ 
7.6S • 

IQ-^ 
7.55 - 


CGA 

10-^ 
8.4S - 

IQ-^ 
7.6S - 

10-^ 

8.OS • 

10-^ 

8.OS • 



10“^ 

10“^ 

IQ-^ 

IQ-^ 



o 

1 

IQ-^ 

10-^ 

10-^ 

[3,2] 

BAY 

4.40 - 

8.80 • 

6.60 • 

6.16 - 

[2. 1] 

BAY 

S.60 - 

1.12 - 

7.40 • 

6 . IS • 


ABT 

10“^ 

8.OS - 

10“^ 

8.OS • 

IQ-^ 

8.OS • 

IQ-^ 

8.OS - 


ABT 

10-^ 

8.OS - 

10-1 

8.OS - 

10-^ 

8.OS • 

10-^ 

8.OS • 



1 

o 

o 

1 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 


ASB 

8.4S - 

8.OS • 

8.2S • 

8.27 - 


ASB 

7.6S - 

8.4S - 

8.OS • 

7.90 • 


ADC 

10“^ 
5.22 - 

10“^ 

8.OS • 

10“^ 
6.6S • 

10“^ 
6.S5 - 


ADC 

10“^ 
4.82 - 

10“^ 
8,84 - 

10“^ 
6.8S • 

10“^ 

6.16 • 


CBO 

10“^ 
4.02 - 

10“^ 

S.29 

10“^ 
1.67 • 

10“^ 
1.S4 - 


CBO 

10“^ 
4.02 - 

10“^ 
S.29 - 

10“^ 
1.67 • 

10“^ 

1.12 • 


CBl 

10“^ 

0.000 

10“1 
9.20 • 

10“1 
4,60 • 

10“1 
S.68 - 


CBl 

10“^ 

0.000 

10“1 
9,84 - 

10“1 
4.92 • 

10“1 

S.28 • 


CB2 

0.000 

10“^ 
6.22 • 

10“^ 
S.ll • 

10“^ 
2.49 - 


CB2 

0.000 

10“^ 
9.92 - 

10“^ 
4.96 • 

10“^ 

S.Sl • 


ACl 

8.OS - 

10“1 
6.4S • 

10“1 
7.2S • 

10“1 
7.S9 - 


ACl 

8.OS - 

10“1 
6.02 - 

10“1 

7.OS • 

10“1 

7.S6 • 


AC2 

10“^ 

0.000 

10“^ 
9.12 • 

10“^ 
4,56 • 

10“^ 
S.65 - 


AC2 

10“^ 
4.02 - 

10“^ 
8,51 - 

10“^ 
4.28 • 

10“^ 

2.86 • 


ACS 

4.02 - 

10“1 

8.OS • 

10“1 
4.04 • 

10“1 
S.24 - 


ACS 

10“^ 

0.000 

10“1 
9,92 - 

10“1 
4.96 • 

10“1 

S.Sl • 


CSA 

10“^ 
7.6S - 

10“1 
7.2S • 

10“1 
7.4S • 

10“1 
7.47 - 


CSA 

7.6S - 

10“1 
6.02 - 

10“1 
6.8S • 

10“1 

7.10 • 


CGA 

10“^ 
6.8S - 

10“^ 
8.4S • 

10“^ 
7.6S • 

10“^ 
7.47 - 


CGA 

10“^ 
6.8S - 

10“2 
9.24 - 

10“^ 

8.OS • 

10“^ 

7.6S • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 

[3, 1] 

BAY 

2.80 - 

1.64 • 

9.60 • 

6.20 - 

[5, 1] 

BAY 

2.00 - 

2.00 - 

1.10 • 

5.00 • 


ABT 

10“^ 
7.2S - 

10“1 
7.6S • 

10“^ 
7.4S • 

10“^ 
7.SS - 


ABT 

10“^ 
6.8S - 

10“1 
8.4S - 

10“1 
7.6S • 

10“^ 

7.10 • 


ASB 

10“^ 

8.OS - 

10“^ 

8.OS • 

10“^ 

8,OS • 

10“^ 

8.OS - 


ASB 

10“^ 

8.OS - 

10“^ 
7.2S - 

10“^ 
7.6S • 

10“^ 

7.90 • 


ADC 

10“^ 
S.21 - 

10“^ 
1.41 • 

10“^ 
8.6S • 

10“^ 
5.92 - 


ADC 

10“^ 
1.61 - 

10“^ 
2.77 - 

10“^ 

1.47 • 

10“^ 

5.96 • 


CBO 

10“^ 
4.02 - 

10“1 
S.41 • 

10“^ 
1.7S • 

10“^ 
8.84 - 


CBO 

10“^ 
4.02 - 

10“1 
S,29 - 

10“1 
1.67 • 

10“^ 

5.82 • 


CBl 

10“^ 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 
2.50 - 


CBl 

10“^ 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 

1.67 • 


CB2 

0.000 

1.000 

10“1 
5,00 • 

10“1 
2.50 - 


CB2 

0.000 

1.000 

10“1 
5.00 • 

10“1 

1.67 • 


ACl 

7.6S - 

6.4S • 

10“^ 

7.OS • 

10“^ 
7.SS - 


ACl 

4.82 - 

8.OS - 

10“^ 

6.4S 

10“^ 

5.S5 • 


AC2 

10“^ 
4.02 - 

10“^ 
9.20 • 

10“^ 
4.62 • 

10“^ 
2.SS - 


AC2 

10“^ 

0.000 

10“^ 
9,96 - 

10“^ 
4.98 • 

10“^ 

1.66 • 


ACS 

10“^ 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 
2.50 - 


ACS 

0.000 

10“^ 

1,000 

10“^ 
5.00 • 

10“^ 

1.67 • 


CSA 

8.4S - 

6.4S • 

10“1 
7.4S • 

10“1 
7.9S - 


CSA 

8.84 - 

5.62 - 

10“1 
7.2S • 

10“1 

8.SO • 


CGA 

10“^ 
4.82 - 

10“^ 
8.4S • 

10“^ 
6.6S • 

10“^ 
5.72 - 


CGA 

10“^ 
6.02 - 

10“^ 
8.84 - 

10“^ 

7.4S • 

10“^ 

6.49 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

1 

o 

o 

1 

to 

10“^ 

[7, 1] 

BAY 

2.00 - 

2.S6 • 

1.28 • 

4.70 - 

[10, 1] 

BAY 

1.60 - 

2.72 - 

1.44 • 

S.9S • 


ABT 

10“^ 
6.8S - 

10“^ 
8.4S • 

10“^ 
7,6S • 

10“^ 

7.OS - 


ABT 

10“^ 
6.8S - 

10“^ 
8.4S - 

10“^ 
7.6S • 

10“^ 

6.97 • 


ASB 

10“^ 
7.6S - 

10“^ 

8.OS • 

10“^ 
7.8S • 

10“^ 
7.68 - 


ASB 

10“^ 
7.2S - 

10“^ 

8.OS - 

10“^ 
7.6S • 

10“^ 

7.SO • 


ADC 

10“^ 
1.61 - 

10“^ 
2.89 • 

10“^ 
1.5S • 

10“^ 
5.02 - 


ADC 

10“^ 
1.20 - 

10“^ 
2.97 - 

10“^ 
1.55 • 

10“^ 

S.80 • 


CBO 

10“^ 
4.02 - 

10“1 

S.29 

10“1 
1.67 • 

10“^ 
4.47 - 


CBO 

10“^ 
4.02 - 

10“1 
S.41 - 

10“1 
1.7S • 

10“^ 

S.47 • 


CBl 

10“^ 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 
1.25 - 


CBl 

10“^ 

0.000 

10“^ 

1,000 

10“^ 
5.00 • 

10“^ 

9.09 • 


CB2 

0.000 

1.000 

10“1 
5.00 • 

10“1 
1.25 - 


CB2 

0.000 

1.000 

10“1 
5.00 • 

10“^ 

9.09 • 


ACl 

4.42 - 

1.04 • 

10“^ 
7.4S • 

10“^ 
5.17 - 


ACl 

4.42 - 

1.08 - 

10“^ 
7.6S • 

10“^ 

5.00 • 


AC2 

10“^ 

0.000 

10“1 
9.56 • 

10“^ 
4.78 • 

10“^ 
1.19 - 


AC2 

10“^ 

0.000 

10“1 
9,92 - 

10“^ 
4.96 • 

10“^ 

9.02 • 


ACS 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 
1.25 - 


ACS 

0.000 

10“^ 

1,000 

10“^ 
5.00 • 

10“^ 

9.09 • 


CSA 

9.24 - 

6.02 • 

10“1 
7,6S • 

10“1 
8.84 - 


CSA 

8.4S - 

5.22 - 

10“1 
6.8S • 

10 “^ 

8.14 • 


CGA 

10 “^ 
5.22 • 

10 “^ 
8.84 • 

10 “^ 

7,OS • 

10 “^ 
5.67 - 


CGA 

10 “^ 
5.22 - 

10“^ 
1.00 - 

10 “^ 
7.6S • 

10 “^ 

5.66 • 



1 

o 

o 

1 

10 “^ 

10 ”^ 



o 

1 

10 “^ 

o 

1 

to 

10 “^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 


[25, 1] 

BAY 

4.00 - 

4.08 • 

2.06 • 

1.95 - 

[50, 1] 

BAY 

0.000 

4.84 - 

2.42 

9.49 • 


ABT 

10“^ 
6.02 - 

10“1 
8.4S • 

10“1 
7.2S • 

10“^ 
6.12 - 


ABT 

6.4S - 

10“1 

8.OS - 

10“1 
7.2S • 

10“^ 

6.46 • 


ASB 

10“^ 
7.6S - 

10“^ 
7.2S • 

10“^ 
7,4S • 

10“^ 
7.62 - 


ASB 

10“^ 
6.4S - 

10“^ 
8.4S - 

10“^ 

7.4S • 

10“^ 

6.47 • 


ADC 

10“^ 
4.02 - 

10“^ 

S.29 

10“^ 
1.67 • 

10“^ 
1.65 - 


ADC 

10“^ 
4.02 - 

10“^ 
S.29 - 

10“^ 
1.67 • 

10“^ 

1.04 • 


CBO 

10“^ 
4.02 - 

10“1 
S.29 • 

10“1 
1.67 • 

10“^ 
1.65 - 


CBO 

10“^ 
4.02 - 

10“1 
S.29 - 

10“1 
1.67 • 

10“^ 

1.04 • 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“^ 
S.85 - 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“^ 

1.96 • 


CB2 

0.000 

1.000 

10“1 
5.00 • 

10“^ 
S.85 - 


CB2 

0.000 

1.000 

10“1 
5.00 • 

10“^ 

1.96 • 


ACl 

8.OS - 

S.25 

10“1 
1.67 • 

10“^ 
2.02 - 


ACl 

4.02 - 

S.29 - 

10“1 
1.67 • 

10“^ 

1.04 • 


AC2 

10“^ 

0.000 

10“1 
9.96 • 

1 

o 

10“^ 
S.8S - 


AC2 

10“^ 

0.000 

10“1 
9.96 - 

10“1 
4.98 • 

10“^ 

1.95 • 


ACS 

0.000 

10“1 

1.000 

10“^ 
5.00 • 

10“^ 
S.85 - 


ACS 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“^ 

1.96 • 


CSA 

6.8S - 

6.8S • 

10“1 
6.8S • 

10“^ 
6.8S - 


CSA 

5.62 - 

9.24 - 

10“1 
7.4S • 

10“^ 

5.69 • 


CGA 

10“^ 
5.62 - 

10“^ 
1.08 • 

10“^ 
8.2S • 

10“^ 
5.82 - 


CGA 

10“^ 
S.61 - 

10“^ 
1.49 - 

10“^ 

9.24 

10“^ 

S.8S • 



1 

o 

10“1 

10“^ 

10“^ 



10“^ 

10“1 

10“^ 

10“^ 

[100, 1] 

BAY 

0.000 

5.80 • 

2.90 • 

5.74 - 








ABT 

S.21 • 

10“1 
1.29 • 

10“1 

8.OS • 

10“^ 
S.Sl - 








ASB 

10“^ 
6.02 - 

10“1 
8.4S • 

10“^ 
7.2S • 

10“^ 
6.05 - 








ADC 

10“^ 
4.02 - 

10“^ 

S.29 

10“^ 
1.67 • 

10“^ 
7.24 - 








CBO 

10“^ 
4.02 • 

10“1 
S.29 • 

10“1 
1.67 • 

10“^ 
7.24 - 








CBl 

10“^ 

0.000 

10“^ 
8.76 • 

10“^ 
4.S8 • 

10“^ 
8.67 - 








CB2 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“^ 
9.90 - 








ACl 

4.02 - 

S.29 

10“^ 
1.67 • 

10“^ 
7.24 - 








AC2 

10“^ 

0.000 

10“1 
9.92 • 

10“1 
4.96 • 

10“^ 
9.82 - 








ACS 

0.000 

10“^ 
9.60 • 

10“^ 
4.80 • 

10“^ 
9.50 - 








CSA 

4.02 - 

10“1 
1.61 • 

10“1 
1.00 • 

10“^ 
4.14 - 








CGA 

10 “^ 
2.81 - 

10“^ 
1.61 • 

10 “^ 
9.44 • 

10 “^ 
2.94 - 









1 

o 

10“1 

10 “^ 

10 “^ 
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in all the graphs to have a common reference across the representations. 











































Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1, 100] 

ABT 

4.14 - 

1.95 • 

S.04 • 

1.97 - 

[1, 50] 

ABT 

S.51 - 

2.S9 - 

2.95 • 

2.41 • 


ASB 

10“1 

5.SO - 

10“1 
8 .6S • 

10“1 
S.08 • 

10“1 
9.07 - 


ASB 

10“1 
5.66 - 

10“1 
7,4S - 

10“1 
S.20 • 

10“1 

8.S9 • 


ADC 

10 “^ 
s.ss - 

10 “^ 

0.000 

10 “^ 
1.67 • 

10 “^ 
S.SO - 


ADC 

10 “^ 
S.SS - 

10 “^ 

0.000 

10 “^ 
1.67 • 

10 “^ 

6.54 • 


CBO 

10“1 
9.66 - 

0.000 

10“1 
4,8S • 

10 “^ 
9.56 - 


CBO 

10“1 
9.66 - 

0.000 

10“1 
4.8S • 

10“3 

1.89 • 


CBl 

10 “^ 
9.66 - 

0.000 

10 “^ 
4,8S • 

10 “^ 
9.56 - 


CBl 

10 “^ 

1.000 

0.000 

10 “^ 
5.00 • 

10 “^ 

1.96 • 


CB2 

10“1 
9.66 - 

0.000 

10“1 
4,8S • 

10 “^ 
9.56 - 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10 “^ 

1.96 • 


ACl 

10“1 
9.12 - 

6.02 • 

1 

o 

10 “^ 
1.50 - 


ACl 

9.66 - 

0.000 

10“1 
4.8S • 

10 “^ 

1.89 • 


AC2 

10“1 
9.12 - 

10 “^ 
6.02 • 

10 “^ 
4,59 • 

10 “^ 
1.50 - 


AC2 

10“1 
9.92 - 

0.000 

10“1 
4.96 • 

10 “^ 

1.95 • 


ACS 

10“1 
9.66 - 

10 “^ 

0.000 

10“1 
4,8S • 

10 “^ 
9.56 - 


ACS 

10“1 
9.66 - 

0.000 

10“1 
4.8S • 

10 “^ 

1.89 • 


CSA 

10“1 
5.80 - 

8 .OS • 

10“1 
S.SO • 

10 “^ 
8.5S - 


CSA 

10“1 
4.70 - 

1.55 - 

10“1 

S.12 

10 “^ 

1.61 • 


CGA 

10“1 
8.45 - 

10 “^ 

0.000 

10“1 
4.2S • 

10 “^ 
8.S7 - 


CGA 

10“1 
7.01 - 

10“1 
1.61 - 

10“1 
S.58 • 

10“1 

2.95 • 



10“1 


10“1 

10 “^ 



10“1 

10 “^ 

10“1 

10 “^ 

[1, 25] 

ABT 

S.Sl - 

2.51 • 

2.91 • 

2.54 - 

[1, 10] 

ABT 

S.05 - 

2.65 - 

2.85 • 

2.69 • 


ASB 

10“1 
5.64 - 

10“1 

8.OS • 

10“1 
S.22 • 

10“1 
9.89 - 


ASB 

10“1 
5.10 - 

10“1 
1,10 - 

10“1 

S.IO 

10“1 

1.47 • 


ADC 

10“1 
S.SS - 

10“^ 

0.000 

10“1 
1.67 • 

10“^ 
1.28 - 


ADC 

10“1 
S.SS - 

10“1 

0.000 

10“1 
1.67 • 

10”1 

S.OS • 


CBO 

10“1 
9.66 - 

0.000 

10“1 
4,8S • 

10“^ 
S.71 - 


CBO 

10“1 
9.12 - 

6.02 - 

10“1 
4.59 • 

10“^ 

8.84 • 


CBl 

10“^ 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
S.85 - 


CBl 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 

9.09 • 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10“^ 
S.85 - 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10“^ 

9.09 • 


ACl 

9.04 - 

1.41 • 

10“^ 
4.59 • 

10“^ 
4.8S - 


ACl 

6.85 - 

1.81 - 

10“^ 

S.51 

10“^ 

7.87 • 


AC2 

10“1 
9.92 - 

10“^ 

0.000 

10“1 
4,96 • 

10“^ 
S.82 - 


AC2 

10“1 
9.70 - 

10“^ 

0.000 

10“1 
4.85 • 

10“^ 

8.82 • 


ACS 

10“^ 
9.90 - 

0.000 

1 

o 

10“^ 
S.81 - 


ACS 

10“^ 
9.80 - 

0.000 

10“^ 
4.90 • 

10“^ 

8.91 • 


CSA 

10“1 
4.00 - 

2.29 • 

10“^ 
S.14 • 

10“^ 
2.S5 - 


CSA 

10“1 
S.49 - 

2.51 - 

10“1 
S.OO • 

10“^ 

2.60 • 


CGA 

10“^ 
6.04 - 

10“^ 
4.42 • 

10“^ 
S.24 • 

10“^ 
6.57 - 


CGA 

10“^ 
5.26 - 

10“^ 
1.06 - 

10“^ 

S.16 

10”^ 

1.45 • 



10“1 

10“^ 

10“1 

10“^ 



10“1 

10“1 

10“1 

10“1 

[1, 7] 

ABT 

S.05 - 

2.65 • 

2,85 • 

2.70 - 

[1. 5] 

ABT 

S.05 - 

2.65 - 

2.85 • 

2.72 • 


ASB 

10“^ 
4.78 - 

10“^ 
l.SS • 

10“^ 
S.05 • 

10“^ 
1.76 - 


ASB 

10“^ 
4.S4 - 

10“^ 
1.5S - 

10“^ 
2.9S • 

10“^ 

1.99 • 


ADC 

10“1 

0.000 

10“1 

S.SS 

10“1 
1.67 • 

10“1 
2.92 - 


ADC 

10“1 

0.000 

10“1 
S.SS - 

10“1 
1.67 • 

10“1 

2.78 • 


CBO 

9.84 - 

10“^ 

0.000 

1 

o 

10“^ 
1.2S - 


CBO 

9.68 - 

10“^ 

0.000 

10“^ 
4.84 • 

10“^ 

1.61 • 


CBl 

10“1 

1.000 

0.000 

10“^ 
5.00 • 

10“1 
1.25 - 


CBl 

10“1 

1.000 

0.000 

10“1 
5.00 • 

10“1 

1.67 • 


CB2 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
1.25 - 


CB2 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 

1.67 • 


ACl 

5.88 - 

7.4S • 

10“1 
S.Sl • 

10“1 
1.S9 - 


ACl 

5.62 - 

8.84 - 

10“1 
S.25 • 

10“1 

1.67 • 


AC2 

10“^ 
9.S6 - 

10“^ 
4.02 • 

10“^ 
4.70 • 

10“^ 
1.20 - 


AC2 

10“^ 
9.78 - 

10“^ 

0.000 

10“^ 
4.89 • 

10“^ 

1.6S • 


ACS 

10“1 
9.82 - 

10“^ 

0.000 

10“1 
4.91 • 

10“1 
1.2S - 


ACS 

10“1 
9.74 - 

0.000 

10“1 
4.87 • 

10“1 

1.62 • 


CSA 

10“^ 
S.S5 - 

2.7S • 

10“^ 
S.04 • 

10“^ 
2.81 - 


CSA 

10“^ 
S.07 - 

2.71 - 

10“^ 
2.89 • 

10“^ 

2.77 • 


CGA 

10“1 
4.72 • 

10“1 
l.Sl • 

10“1 
S.Ol • 

10“1 
1.7S - 


CGA 

10“1 
4.42 - 

10“1 
1.5S - 

10“1 
2.97 • 

10“1 

2.01 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1,3] 

ABT 

S.05 - 

2.65 • 

2.85 • 

2.75 - 

[1.2] 

ABT 

2.97 - 

2.69 - 

2.8S • 

2.78 • 


ASB 

10“1 
4.02 - 

10“1 
1.97 • 

10“1 
2.99 • 

10“1 
2.48 - 


ASB 

10“1 
S.61 - 

10“1 
2.2S - 

10“1 
2.92 • 

10“1 

2.69 • 


ADC 

10“1 
8.4S - 

10“1 
9.68 • 

10“1 
5.26 • 

10“1 
7.47 - 


ADC 

10“1 
9.64 - 

10“1 
9.56 - 

10“1 
5.26 • 

10“1 

6.69 • 


CBO 

10“^ 
9.12 - 

10“1 
6.02 • 

10“1 
4.59 • 

10“1 
2.S2 - 


CBO 

10“^ 
9.68 - 

10“1 

0.000 

10“1 
4.84 • 

10“1 

S.2S • 


CBl 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

10“1 
2.50 - 


CBl 

10“1 

1.000 

0.000 

10“1 
5.00 • 

10“1 

S.SS • 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10“1 
2.50 - 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10“1 
s.ss • 


ACl 

4.58 - 

1.75 • 

10“^ 
S.16 • 

10“^ 
2.45 - 


ACl 

4.02 - 

2.2S - 

10“^ 

S.12 

10“^ 

2.82 • 


AC2 

10“1 
9.58 - 

10“1 
4.02 • 

10“1 
4.81 • 

10“1 
2.42 - 


AC2 

10“1 
9.62 - 

10“1 

0.000 

10“1 
4.81 • 

10“1 

S.21 • 


ACS 

10“^ 
9.68 - 

10“^ 

0.000 

1 

o 

10“^ 
2.42 - 


ACS 

10“^ 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 

S.SS • 


CSA 

10“1 
2.99 - 

2.71 • 

10“^ 
2.85 • 

10“1 
2.78 - 


CSA 

2.97 - 

2.75 - 

10“1 
2.86 • 

10“1 

2.82 • 


CGA 

10“^ 
S.96 - 

10“^ 
1.99 • 

10“^ 
2.97 • 

10“^ 
2.48 - 


CGA 

10“^ 
S.59 - 

10“^ 
2.21 - 

10“^ 
2.90 • 

10“^ 

2.67 • 



10“1 

10“1 

10“1 

10“1 



10“1 

10“1 

10“1 

10“1 

[2,3] 

ABT 

2.97 - 

2.69 • 

2.8S • 

2.80 - 

[1. 1] 

ABT 

2.77 - 

2.81 - 

2.79 • 

2.79 • 


ASB 

10“^ 
S.29 - 

10“^ 
2.S9 • 

10“^ 
2.84 • 

10“^ 
2.75 - 


ASB 

10“^ 
2.95 - 

10“^ 
2.69 - 

10“^ 
2.82 • 

10“^ 

2.82 • 


ADC 

10“1 
9.64 - 

10“1 
9.56 • 

10“1 
5.26 • 

10“1 
6.12 - 


ADC 

10“1 
4.80 - 

10“1 
6.27 - 

10“1 
5.5S • 

10“1 

5.5S • 


CBO 

10“^ 
9.12 - 

10“^ 
4.02 • 

10“^ 
4.58 • 

10“^ 
S.67 - 


CBO 

10“^ 
5.20 - 

10“^ 
S.7S - 

10“^ 
4.47 • 

10“^ 

4.47 • 


CBl 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

10“1 
4.00 - 


CBl 

10“1 
4.10 - 

10“1 
5.60 - 

10“1 
4.85 • 

10“1 

4.85 • 


CB2 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
4.00 - 


CB2 

10“^ 
2.95 - 

10“^ 
2.69 - 

10“^ 
2.82 • 

10“^ 

2.82 • 


ACl 

S.47 - 

2.57 • 

10“1 
S.02 • 

10“1 
2.9S - 


ACl 

10“1 
2.9S - 

10“1 
2.95 - 

10“1 
2.94 • 

10“1 

2.94 • 


AC2 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 
4.00 - 


AC2 

10“^ 
2.95 - 

10“^ 
2.69 - 

10“^ 
2.82 • 

10“^ 

2.82 • 


ACS 

9.88 - 

0.000 

1 

o 

10“1 
S.95 - 


ACS 

10“1 
2.9S - 

10“1 
2.95 - 

10“1 
2.94 • 

10“1 

2.94 • 


CSA 

10“^ 
2.85 - 

2.81 • 

10“^ 
2.8S • 

10“^ 
2.8S - 


CSA 

10“^ 
2.95 - 

10“^ 
2.69 - 

10“^ 
2.82 • 

10“^ 

2.82 • 


CGA 

10“1 
S.S9 - 

10“1 
2.4S • 

10“1 
2.91 • 

10“1 
2.82 - 


CGA 

10“1 
2.95 - 

10“1 
2.69 - 

10“1 
2.82 • 

10”1 

2.82 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 

[3,2] 

ABT 

2.77 - 

2.81 • 

2.79 • 

2.79 - 

[2. 1] 

ABT 

2.77 - 

2.81 - 

2.79 • 

2.78 • 


ASB 

10“1 
2.61 - 

10“1 
S.05 • 

10“1 
2.8S • 

10“1 
2.79 - 


ASB 

10“1 
2.4S - 

10“1 
s.ss - 

10“1 
2.88 • 

10“1 

2.7S • 


ADC 

10“^ 
9.78 - 

10“^ 
6.8S • 

10“^ 
5.2S • 

10“^ 
6.14 - 


ADC 

10“^ 
9.78 - 

10“^ 
6.8S - 

10“^ 
5.2S • 

10“^ 

6.75 • 


CBO 

10“1 
2.01 - 

10“^ 
9.70 • 

10“1 
4.86 • 

10“1 
S.89 - 


CBO 

10“1 
6.02 - 

10“^ 
9.48 - 

10“1 
4.77 • 

10“1 

S.20 • 


CBl 

10“^ 
2.01 - 

10“^ 
9.82 • 

1 

o 

10“^ 
S.94 - 


CBl 

10“^ 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 

S.SS • 


CB2 

10“^ 

0.000 

10“1 

1.000 

10“^ 
5.00 • 

10“1 
4.00 - 


CB2 

0.000 

9.92 - 

10“1 
4.96 • 

10“1 

S.Sl • 


ACl 

2.5S - 

S.49 

10“^ 
S.Ol • 

10“^ 
2.92 - 


ACl 

2.SS - 

10“^ 
S.78 - 

10“^ 
S.05 • 

10“^ 

2.81 • 


AC2 

10“1 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
4.00 - 


AC2 

10“1 

0.000 

10“1 
9.92 - 

10“1 
4.96 • 

10“1 

S.Sl • 


ACS 

0.000 

9.92 • 

10“^ 
4.96 • 

10“^ 
S.97 - 


ACS 

0.000 

10“^ 
9.92 - 

10“^ 
4.96 • 

10“^ 

S.Sl • 


CSA 

2.81 - 

10“1 
2.67 • 

10“1 
2.74 • 

10“1 
2.76 - 


CSA 

2.99 - 

10“1 
2.81 - 

10“1 
2.90 • 

10“1 

2.9S • 


CGA 

10“^ 
2.71 - 

10“^ 
2.95 • 

10“^ 
2.8S • 

10“^ 
2.81 - 


CGA 

10“^ 
2.49 - 

10 “^ 
S.S5 - 

10 “^ 
2.92 • 

10 “^ 

2.78 • 



10“1 

10 “^ 

10 “^ 

10“1 



10“1 

10 “^ 

10“1 

10“1 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[3, 1] 

ABT 

2.77 - 

2.81 • 

2.79 • 

2.78 - 

[5, 1] 

ABT 

2.75 - 

2.87 - 

2.81 • 

2.77 • 


ASB 

10“1 
2.2S - 

10“1 
S.69 • 

10“1 
2.96 • 

10-1 
2.60 - 


ASB 

10-1 
1.79 - 

10-1 
4.08 - 

10-1 
2.9S • 

10-1 

2.17 • 


ADC 

10“1 
9.78 - 

10“1 
6.8S • 

10“1 
5.2S • 

10-1 
7.51 - 


ADC 

10-1 
9.98 - 

10-1 
5.22 - 

10-1 
5.25 • 

10-1 

8.40 • 


CBO 

10“1 
2.01 - 

10“^ 
9.78 • 

• o 

O 1 

10-1 
2.46 - 


CBO 

10-1 
2.01 - 

IQ-^ 
9.78 - 

10-1 
4.90 • 

10-1 

1.65 • 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10-1 
2.50 - 


CBl 

10-^ 

0.000 

10-1 

1.000 

10-1 
5.00 • 

10-1 

1.67 • 


CB2 

0.000 

9.98 • 

1 

o 

10-1 
2.49 - 


CB2 

0.000 

1.000 

10-1 
5.00 • 

10-1 

1.67 • 


ACl 

1.79 - 

10“^ 
4.62 • 

10“^ 
S.20 • 

10-1 
2.49 - 


ACl 

l.SS - 

5.18 - 

10-1 
S.25 • 

10-1 

1.97 • 


AC2 

10“1 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10-1 
2.50 - 


AC2 

10-1 

0.000 

10-1 
9.92 - 

10-1 
4.96 • 

10-1 

1.65 • 


ACS 

0.000 

9.92 • 

10“^ 
4.96 • 

10-1 
2.48 - 


ACS 

0.000 

10-1 
9.92 - 

10-1 
4.96 • 

10-1 

1.65 • 


CSA 

2.95 - 

10“1 
2.79 • 

10“1 
2.87 • 

10-1 
2.91 - 


CSA 

2.8S - 

10-1 
2.97 - 

10-1 
2.90 • 

10-1 

2.85 • 


CGA 

10“^ 

2.IS - 

10“^ 
S.67 • 

10“^ 
2.90 • 

10-1 
2.52 - 


CGA 

10-1 
1.81 - 

IQ-l 
4.20 - 

10-1 
S.OO • 

10-1 

2.21 • 



10“1 

10“1 

10“1 

10-1 



10-1 

10-1 

10-1 

10-1 

P, 1] 

ABT 

2.75 - 

2.87 • 

2.81 • 

2.77 - 

[10, 1] 

ABT 

2.75 - 

2.87 - 

2.81 • 

2.76 • 


ASB 

10“^ 
1.57 - 

10“^ 
4.42 • 

10“^ 
2.99 • 

10-1 
1.92 - 


ASB 

10-1 
l.SS - 

10-1 
4.66 - 

10-1 
S.OO • 

10-1 

1.65 • 


ADC 

10“1 
9.90 - 

10“1 
5.22 • 

10“1 
5.21 • 

10-1 
8.7S - 


ADC 

10-1 
9.90 - 

10-1 
5.22 - 

10-1 

5.21 

10-1 

9.05 • 


CBO 

10“^ 
2.01 - 

10“^ 
9.78 • 

10“^ 
4.90 • 

10-1 
1.24 - 


CBO 

10-1 
2.01 - 

IQ-^ 
9.78 - 

10-1 
4.90 • 

10-1 

9.07 • 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10-1 
1.25 - 


CBl 

10-^ 

0.000 

10-1 

1.000 

10-1 
5.00 • 

10-^ 

9.09 • 


CB2 

2.01 - 

9.98 • 

10“^ 
5.00 • 

10-1 
1.27 - 


CB2 

0.000 

9.92 - 

10-1 
4.96 • 

10-^ 

9.02 • 


ACl 

10“^ 
6.6S - 

10“1 
5.94 • 

10“1 
S.SO • 

10-1 
1.S2 - 


ACl 

2.81 - 

10-1 
6.49 - 

10-1 
S.SS • 

10-^ 

8.45 • 


AC2 

10“^ 

0.000 

10“^ 
9.92 • 

10“^ 
4.96 • 

10-1 
1.24 - 


AC2 

10-^ 

0.000 

IQ-l 
9.92 - 

10-1 
4.96 • 

10-^ 

9.02 • 


ACS 

0.000 

10“1 
9.92 • 

10“1 
4.96 • 

10-1 
1.24 - 


ACS 

0.000 

10-1 
9.92 - 

10-1 
4.96 • 

10-^ 

9.02 • 


CSA 

2.77 - 

10“^ 
S.OS • 

10“^ 
2.90 • 

10-1 
2.80 - 


CSA 

2.7S - 

10-1 
S.OS - 

10-1 
2.88 • 

10-^ 

2.76 • 


CGA 

10“1 
1.51 - 

10“1 
4.42 • 

10“1 
2.96 • 

10-1 
1.87 - 


CGA 

10-1 
1.29 - 

10-1 
4.82 - 

10-1 
S.05 • 

10-1 

1.61 • 



10“^ 

10“^ 

10“^ 

10-1 



10-1 

10-1 

10-1 

10-1 

[25, 1] 

ABT 

2.55 - 

S.IS 

2.84 • 

2.57 - 

[50, 1] 

ABT 

2.S9 - 

S.S9 - 

2.89 • 

2.41 • 


ASB 

10“1 
1.06 - 

10“1 

5.12 

10“1 
S.09 • 

10-1 
1.22 - 


ASB 

10-1 
9.24 - 

10-1 
5.S8 - 

10-1 

S.15 

10-1 

1.01 • 


ADC 

10 “^ 
S.27 - 

10 “^ 
6.75 • 

10 “^ 
5.01 • 

10-1 
S.41 - 


ADC 

10 -^ 
1.00 - 

10-1 
9.48 - 

10-1 
4.79 • 

10-1 

2.84 • 


CBO 

10“1 
1.00 - 

10“1 
9.48 • 

10“1 
4.79 • 

10-1 
4.61 - 


CBO 

10 -^ 
1.00 - 

10-1 
9.48 - 

10-1 
4.79 • 

10 -^ 

2.84 • 


CBl 

10 “^ 

0.000 

10 “^ 

1.000 

10 “^ 
5.00 • 

IQ-^ 
S.85 - 


CBl 

10 -^ 

0.000 

IQ-l 

1.000 

10-1 
5.00 • 

10 -^ 

1.96 • 


CB2 

0.000 

9.94 • 

• o 

IQ-^ 
S.82 - 


CB2 

0.000 

9.94 - 

10-1 
4.97 • 

10 -^ 

1.95 • 


ACl 

1.00 - 

10 “^ 
9.48 • 

10 “^ 
4.79 • 

IQ-^ 
4.61 - 


ACl 

2.01 - 

IQ-l 
9.48 - 

10-1 
4.75 • 

10-^ 

2.06 • 


AC2 

10“^ 

0.000 

10“1 
9.92 • 

10“1 
4.96 • 

IQ-^ 
S.82 - 


AC2 

10-^ 

0.000 

10-1 
9.92 - 

10-1 
4.96 • 

10-^ 

1.95 • 


ACS 

2.01 - 

10“^ 
9.70 • 

10“^ 
4.86 • 

IQ-^ 
S.92 - 


ACS 

2.01 - 

10-1 
9.70 - 

10-1 
4.86 • 

10-^ 

2.10 • 


CSA 

10“^ 
2.5S - 

10“1 
S.5S • 

10-1 
S.OS • 

IQ-^ 
2.57 - 


CSA 

10-^ 
2.15 - 

10-1 
4.18 - 

10-1 

S.16 

10-^ 

2.19 • 


CGA 

10“^ 

8.OS - 

10“^ 
5.86 • 

10“1 
s.ss • 

10-1 
9.98 - 


CGA 

10-1 
S.21 - 

10-1 
6.71 - 

10-1 

S.51 

10-1 

4.46 • 



10“^ 

10“^ 

10-1 

10”^ 



10-^ 

10-1 

10-1 

10-^ 


Table A-2 - Continued on next page 


36 



Cost 

Alg 

FNR 

FPR 

CE 

NEC Cost Alg FNR FPR CE NEC 

[100, 1] 

ABT 

2.29 - 

3.59 • 

2.94 • 

2.30 - 



10“1 

10“1 

10“1 

10“1 


ASB 

9.64 - 

5.12 • 

3.04 • 

1.01 - 



1 

o 

10“1 

10“1 

10“1 


ADC 

1.00 - 

9.48 • 

4.79 • 

1.93 - 



10 “^ 

10“1 

10“1 

10 “^ 


CBO 

1.00 - 

9.48 • 

4.79 • 

1.93 - 



10 “^ 

10“1 

10“1 

10 “^ 


CBl 

1.00 - 

9.48 • 

4.79 • 

1.93 - 



10 “^ 

10“1 

10“1 

10 “^ 


CB2 

1.00 - 

9.48 • 

4.79 • 

1.93 - 



1 

o 

10 “^ 

10 “^ 

10 “^ 


ACl 

2.01 - 

9.48 • 

4.75 • 

1.14 - 



10 “^ 

10“1 

10“1 

10 “^ 


AC2 

2.01 - 

9.48 • 

4.75 • 

1.14 - 



10 “^ 

10 “^ 

10 “^ 

10 “^ 


ACS 

1.00 - 

9.48 • 

4.79 • 

1.93 - 



1 

o 

10“1 

10“1 

10 “^ 


CSA 

1.31 - 

5.22 • 

3.26 • 

1.34 - 



10 “^ 

10 “^ 

10 “^ 

10 “^ 


CGA 

1.00 - 

8.03 • 

4.07 • 

1.79 - 



1 

o 

10“1 

10“1 

10 “^ 




Table A-2; 

Results 

obtained for the Two Clouds Dataset. 
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in all the graphs to have a common reference across the representations. 



































Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1, 100] 

ABT 

2.11 - 

2.95 • 

1.20 • 

3.13 - 

[1, 50] 

ABT 

1.90 - 

3.80 - 

1.14 • 

4.10 • 


ASB 

10“1 
1.56 - 

10 “^ 
4.22 • 

10“1 
9.92 • 

10 “^ 
4.33 - 


ASB 

10“1 
1.52 - 

10 “^ 
3.80 - 

10“1 

9.49 

10 “^ 

4.02 • 


ADC 

10 “^ 
5.78 - 

10 “^ 
8.44 • 

10 “^ 
2.93 • 

10 “^ 
1.41 - 


ADC 

10 “^ 
4.94 - 

10 “^ 
1.27 - 

10 “^ 
2.53 • 

10 “^ 

2.21 • 


CBO 

10“1 
5.78 - 

10 “^ 
8.44 • 

10“1 
2.93 • 

10 “^ 
1.41 - 


CBO 

10“1 
4.94 - 

10 “^ 
1.27 - 

10“1 
2.53 • 

10 “^ 

2.21 • 


CBl 

10 “^ 
9.32 - 

10 “^ 

0.000 

10 “^ 
4.66 • 

10 “^ 
9.23 - 


CBl 

10 “^ 
9.70 - 

10 “^ 

0.000 

10 “^ 
4.85 • 

10 “^ 

1.90 • 


CB2 

10“1 
9.28 - 

0.000 

10“1 
4.64 • 

10 “^ 
9.19 - 


CB2 

10“1 
9.79 - 

0.000 

10“1 
4.89 • 

10 “^ 

1.92 • 


ACl 

10“1 
4.09 - 

1.27 • 

10“1 
2.11 • 

10 “^ 
1.66 - 


ACl 

10“1 
2.19 - 

1.27 - 

10“1 
1.16 • 

10 “^ 

1.67 • 


AC2 

10“1 
8.40 - 

10 “^ 

0.000 

10“1 
4.20 • 

10 “^ 
8.31 - 


AC2 

10“1 
8.31 - 

10 “^ 

0.000 

10“1 
4.16 • 

10 “^ 

1.63 • 


ACS 

10“1 
9.07 - 

0.000 

10“1 
4.54 • 

10 “^ 
8.98 - 


ACS 

10“1 
9.07 - 

0.000 

10“1 
4.54 • 

10 “^ 

1.78 • 


CSA 

10“1 
1.56 - 

4.64 • 

10“1 
1.01 • 

10 “^ 
4.75 - 


CSA 

10“1 
1.43 - 

3.80 - 

10“1 
9.07 • 

10 “^ 

4.00 • 


CGA 

10“1 
2.36 - 

10 “^ 
2.53 • 

10“1 
1.31 • 

10 “^ 
2.74 - 


CGA 

10“1 
2.07 - 

10 “^ 
3.38 - 

10 “^ 
1.20 • 

10 “^ 

3.71 • 



10“1 

10 “^ 

10“1 

10 “^ 



10“1 

10 “^ 

10“1 

10“^ 

[1, 25] 

ABT 

1.98 - 

3.80 • 

1.18 • 

4.41 - 

[1, 10] 

ABT 

1.77 - 

3.80 - 

1.08 • 

5.06 • 


ASB 

10“1 
1.65 - 

10“^ 
3.80 • 

10“1 
1.01 • 

10“^ 
4.28 - 


ASB 

10“1 
1.73 - 

10“^ 
3.80 - 

10“1 
1.05 • 

10“^ 

5.02 • 


ADC 

10“1 
4.77 - 

10“^ 
4.22 • 

10“1 
2.41 • 

10“^ 
2.24 - 


ADC 

10“1 
3.42 - 

10“^ 
8.44 - 

10“1 
1.75 • 

10“^ 

3.87 • 


CBO 

10“1 
6.08 - 

10“^ 
8.44 • 

10“1 
3.08 • 

10“^ 
3.15 - 


CBO 

10“1 
5.91 - 

10“^ 
8.44 - 

10“1 
3.00 • 

10“^ 

6.14 • 


CBl 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 
3.85 - 


CBl 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 

9.09 • 


CB2 

9.83 - 

0.000 

10“1 
4.92 • 

10“^ 
3.78 - 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10“^ 

9.09 • 


ACl 

10“^ 
1.90 - 

2.11 • 

10“^ 
1.05 • 

10“^ 
2.76 - 


ACl 

1.52 - 

3.80 - 

10“^ 
9.49 • 

10“^ 

4.83 • 


AC2 

10“1 
9.37 - 

10“^ 

0.000 

10“1 
4.68 • 

10“^ 
3.60 - 


AC2 

10“1 
8.95 - 

10“^ 

0.000 

10“^ 
4.47 • 

10“^ 

8.13 • 


ACS 

10“^ 
9.28 - 

0.000 

10“^ 
4.64 • 

10“^ 
3.57 - 


ACS 

10“^ 
9.79 - 

0.000 

10“^ 
4.89 • 

10“^ 

8.90 • 


CSA 

10“1 
9.70 - 

4.22 • 

10“1 
6.96 • 

10“^ 
4.43 - 


CSA 

10“1 
1.01 - 

4.22 - 

10“1 
7.17 • 

10“^ 

4.76 • 


CGA 

10“^ 
2.19 - 

10“^ 
3.38 • 

10“^ 
1.27 • 

10“^ 
4.09 - 


CGA 

10“^ 
2.03 - 

10“^ 
3.38 - 

10“^ 
1.18 • 

10“^ 

4.91 • 



10“1 

10“^ 

10“1 

10“^ 



10“1 

10“^ 

10“1 

10“^ 

[1, 7] 

ABT 

1.69 - 

3.80 • 

1.03 • 

5.43 - 

[1. 5] 

ABT 

1.60 - 

3.80 - 

9.92 • 

5.84 • 


ASB 

10“^ 
1.86 - 

10“^ 
3.80 • 

10“^ 
1.12 • 

10“^ 
5.64 - 


ASB 

10“^ 
1.56 - 

10“^ 
3.80 - 

10“^ 
9.70 • 

10“^ 

5.77 • 


ADC 

10“1 
2.62 - 

10“^ 
8.44 • 

10“1 
1.35 • 

10“^ 
4.01 - 


ADC 

10“1 
2.07 - 

10“^ 
8.44 - 

10“^ 
1.08 • 

10“^ 

4.15 • 


CBO 

10“^ 
5.82 - 

10“^ 
8.44 • 

10“^ 
2.95 • 

10“^ 
8.02 - 


CBO 

10“^ 
5.82 - 

10“^ 
8.44 - 

10“^ 
2.95 • 

10“^ 

1.04 • 


CBl 

10“1 
9.87 - 

10“^ 

0.000 

1 

o 

10“^ 
1.23 - 


CBl 

10“1 
9.96 - 

10“^ 

0.000 

10“1 
4.98 • 

10“1 

1.66 • 


CB2 

10“^ 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
1.25 - 


CB2 

10“^ 
9.92 - 

0.000 

10“^ 
4.96 • 

10“^ 

1.65 • 


ACl 

1.22 - 

4.22 • 

10“1 
8.23 • 

10“1 
5.22 - 


ACl 

10“1 
1.14 - 

4.22 - 

10“1 
7.81 • 

10“1 

5.41 • 


AC2 

10 “^ 
9.92 - 

10 “^ 

0.000 

10 “^ 
4.96 • 

10 “^ 
1.24 - 


AC2 

10 “^ 
9.83 - 

10 “^ 

0.000 

10 “^ 
4.92 • 

10 “^ 

1.64 • 


ACS 

10“1 

1.000 

2.11 • 

10“1 
5.11 • 

10“1 
1.43 - 


ACS 

10“1 

1.000 

2.11 - 

10“1 

5.11 

10“1 

1.84 • 


CSA 

1.10 - 

10 “^ 
4.22 • 

10 “^ 
7.59 • 

10 “^ 
5.06 - 


CSA 

1.10 - 

10 “^ 
3.80 - 

10 “^ 
7.38 • 

10 “^ 

4.99 • 


CGA 

10“1 
1.98 - 

10 “^ 
3.38 • 

10 “^ 
1.16 • 

10 “^ 
5.43 - 


CGA 

10“1 
1.77 - 

10 “^ 
3.80 - 

10 “^ 
1.08 • 

10 “^ 

6.12 • 



10 “^ 

10 “^ 

10 “^ 

10 “^ 



10 “^ 

10 “^ 

10 “^ 

10 “^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1,3] 

ABT 

1.69 - 

3.80 • 

1.03 • 

7.07 - 

[1,2] 

ABT 

1.69 - 

3.80 - 

1.03 • 

8.16 • 


ASB 

10“1 
1.60 - 

10“^ 
3.80 • 

10“1 
9.92 • 

IQ-^ 
6.86 - 


ASB 

10-1 
1.69 - 

IQ-^ 
3.80 - 

10-1 
1.03 • 

10-^ 

8.16 • 


ADC 

10“1 
1.60 - 

10“^ 
1.27 • 

10“^ 
8.65 • 

IQ-^ 
4.96 - 


ADC 

10-1 
1.27 - 

IQ-^ 
3.38 - 

10-1 
8.02 • 

10-^ 

6.47 • 


CBO 

10“1 
5.82 - 

10“^ 
8.44 • 

10“^ 
2.95 • 

IQ-^ 
1.52 - 


CBO 

10-1 
5.82 - 

IQ-^ 
8.44 - 

10-^ 
2.95 • 

10-^ 

2.00 • 


CBl 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

10-1 
2.50 - 


CBl 

10-1 
9.75 - 

IQ-^ 

0.000 

10-1 
4.87 • 

10-1 

3.25 • 


CB2 

9.66 - 

0.000 

10“1 
4.83 • 

10-1 
2.42 - 


CB2 

10-1 
9.20 - 

0.000 

10-1 
4.60 • 

10-1 

3.07 • 


ACl 

10“^ 
1.18 - 

4.22 • 

10“^ 
8.02 • 

10-1 
6.12 - 


ACl 

10-1 
1.18 - 

4.22 - 

10-1 
8.02 • 

10-1 

6.75 • 


AC2 

10“1 
8.35 - 

10“^ 

0.000 

10“^ 
4.18 • 

IQ-^ 
2.09 - 


AC2 

10-1 
9.24 - 

IQ-^ 

0.000 

IQ-^ 
4.62 • 

10-^ 

3.08 • 


ACS 

10“^ 

1.000 

0.000 

10“^ 
5.00 • 

10-1 
2.50 - 


ACS 

10-1 
9.28 - 

0.000 

10-1 
4.64 • 

10-1 

3.09 • 


CSA 

1.22 - 

3.80 • 

10“1 
8.02 • 

10-1 
5.91 - 


CSA 

10-1 
1.48 - 

4.22 - 

10-1 

9.49 

10-1 

7.74 • 


CGA 

10“^ 
1.90 - 

10“^ 
3.38 • 

10“^ 
1.12 • 

IQ-^ 
7.28 - 


CGA 

10-1 
1.69 - 

IQ-^ 
3.80 - 

10-^ 
1.03 • 

10-^ 

8.16 • 



10“1 

10“^ 

10“1 

IQ-^ 



10-1 

IQ-^ 

10-1 

10-^ 

[2,3] 

ABT 

1.69 - 

3.80 • 

1.03 • 

9.03 - 

[1, 1] 

ABT 

1.60 - 

3.80 - 

9.92 • 

9.92 • 


ASB 

10“^ 
1.60 - 

10“^ 
3.80 • 

10“^ 
9.92 • 

IQ-^ 
8.69 - 


ASB 

10-1 
1.60 - 

IQ-^ 
3.80 - 

10-^ 
9.92 • 

10-^ 

9.92 • 


ADC 

10“1 
1.10 - 

10“^ 
4.22 • 

10“^ 
7.59 • 

IQ-^ 
6.92 - 


ADC 

10-1 
4.64 - 

IQ-^ 
6.33 - 

10-^ 
5.49 • 

10-^ 

5.49 • 


CBO 

10“^ 
5.78 - 

10“^ 
8.44 • 

10“^ 
2.93 • 

IQ-^ 
2.36 - 


CBO 

10-^ 
1.27 - 

IQ-^ 
9.28 - 

10-^ 
1.10 • 

10-^ 

1.10 • 


CBl 

10“1 
9.11 - 

10“^ 

0.000 

10“1 
4.56 • 

10-1 
3.65 - 


CBl 

10-1 
1.56 - 

IQ-^ 
1.18 - 

10-1 
1.37 • 

10-1 

1.37 • 


CB2 

10“^ 
7.72 - 

4.22 • 

10“^ 
3.88 • 

10-1 
3.11 - 


CB2 

10-1 
1.60 - 

10-1 
3.80 - 

10-1 
9.92 • 

10-1 

9.92 • 


ACl 

10“1 
1.22 - 

10“^ 
4.22 • 

10“1 
8.23 • 

10-1 
7.43 - 


ACl 

10-1 
1.52 - 

IQ-^ 
4.64 - 

10-^ 
9.92 • 

10-^ 

9.92 • 


AC2 

10“^ 
6.79 - 

10“^ 
4.22 • 

10“^ 
3.42 • 

IQ-^ 
2.74 - 


AC2 

10-1 
1.60 - 

IQ-^ 
3.80 - 

10-^ 
9.92 • 

10-^ 

9.92 • 


ACS 

10“1 
8.27 - 

10“^ 

0.000 

• o 

10-1 
3.31 - 


ACS 

10-1 
1.52 - 

IQ-^ 
4.64 - 

10-^ 
9.92 • 

10-^ 

9.92 • 


CSA 

10“^ 
1.52 - 

4.64 • 

10“^ 
9.92 • 

10-1 
8.86 - 


CSA 

10-1 
1.60 - 

IQ-^ 
3.80 - 

10-^ 
9.92 • 

10-^ 

9.92 • 


CGA 

10“1 
1.56 - 

10“^ 
4.22 • 

10“^ 
9.92 • 

IQ-^ 
8.78 - 


CGA 

10-1 
1.60 - 

IQ-^ 
3.80 - 

10-^ 
9.92 • 

10-^ 

9.92 • 



10“^ 

10“^ 

10“^ 

IQ-^ 



10-1 

IQ-^ 

10-^ 

10-^ 

[3,2] 

ABT 

1.65 - 

3.80 • 

1.01 • 

1.14 - 

[2, 1] 

ABT 

1.65 - 

3.80 - 

1.01 • 

1.22 • 


ASB 

10“1 
1.56 - 

10“^ 
3.80 • 

10“1 
9.70 • 

10-1 
1.09 - 


ASB 

10-1 
1.65 - 

IQ-^ 
3.80 - 

10-1 
1.01 • 

10-1 

1.22 • 


ADC 

10“^ 
1.69 - 

10“^ 
8.86 • 

10“^ 
5.27 • 

10-1 
4.56 - 


ADC 

10-1 
1.69 - 

IQ-^ 
1.10 - 

10-1 
6.33 • 

10-1 

4.78 • 


CBO 

10“^ 
1.69 - 

10“^ 
7.00 • 

10“^ 
3.59 • 

IQ-^ 
2.90 - 


CBO 

10-^ 
1.69 - 

10-1 
7.00 - 

10-^ 
3.59 • 

10-^ 

2.45 • 


CBl 

10“^ 

0.000 

10“^ 
7.55 • 

10“^ 
3.78 • 

10-1 
3.02 - 


CBl 

10-^ 

0.000 

IQ-l 
9.37 - 

10-1 
4.68 • 

10-1 

3.12 • 


CB2 

0.000 

10“1 
7.05 • 

10“1 
3.52 • 

10-1 
2.82 - 


CB2 

0.000 

10-1 
8.73 - 

10-1 
4.37 • 

10-1 

2.91 • 


ACl 

1.60 - 

10“^ 
4.64 • 

10“^ 
1.03 • 

10-1 
1.15 - 


ACl 

1.69 - 

10-1 
4.64 - 

10-1 
1.08 • 

10-1 

1.28 • 


AC2 

10“1 
4.22 - 

10“^ 
9.58 • 

10“1 
4.81 • 

10-1 
3.86 - 


AC2 

10-1 

0.000 

IQ-^ 

1.000 

10-1 
5.00 • 

10-1 

3.33 • 


ACS 

10“^ 
1.52 - 

10“^ 
7.05 • 

10“^ 
4.28 • 

10-1 
3.73 - 


ACS 

1.52 - 

7.05 - 

10-1 
4.28 • 

10-1 

3.36 • 


CSA 

10“1 
1.90 - 

10“1 
3.80 • 

10-1 
1.14 • 

10-1 
1.29 - 


CSA 

10-1 
1.48 - 

10-1 
3.80 - 

10-1 
9.28 • 

10-1 

1.11 • 


CGA 

10“^ 
1.73 - 

10“^ 
3.80 • 

io“i 

1.05 • 

10-1 
1.19 - 


CGA 

10-1 
1.48 - 

IQ-^ 
3.80 - 

10-^ 
9.28 • 

10-1 

1.11 • 



10“^ 

10“^ 

10-1 

10-1 



10-1 

10“^ 

10”^ 

10-1 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[3, 1] 

ABT 

1.65 - 

3.80 • 

1.01 • 

1.33 - 

[5. 1] 

ABT 

1.56 - 

3.80 - 

9.70 • 

1.36 • 


ASB 

10“1 
1.65 - 

10“^ 
3.80 • 

10“1 
1,01 • 

10-1 
1.33 - 


ASB 

10-1 
1.77 - 

IQ-^ 
4,22 - 

10-^ 
1.10 • 

10-1 

1.55 • 


ADC 

10“1 
1.69 - 

10“^ 
1.69 • 

10“1 
9.28 • 

10-1 
5.49 - 


ADC 

10-1 
1.69 - 

IQ-^ 
2,03 - 

10-1 
1.10 • 

10-1 

4.78 • 


CBO 

10“^ 
1.69 - 

10“1 
7.00 • 

10“^ 
3,59 • 

IQ-^ 
1.88 - 


CBO 

10-^ 
1.69 - 

10-1 
7.05 - 

10-1 

3.61 

10-^ 

1.32 • 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10-1 
2.50 - 


CBl 

10-^ 

0.000 

10-1 

1.000 

10-1 
5.00 • 

10-1 

1.67 • 


CB2 

0.000 

1.000 

10“1 
5.00 • 

10-1 
2.50 - 


CB2 

0.000 

1,000 

10-1 
5.00 • 

10-1 

1.67 • 


ACl 

1.60 - 

3.80 • 

10 “^ 
9.92 • 

10-1 
1.30 - 


ACl 

1.31 - 

4,22 - 

10-1 
8.65 • 

10-1 

1.16 • 


AC2 

10“1 
1.4S - 

10 “^ 
9.83 • 

10 “^ 
5.63 • 

10-1 
3.53 - 


AC2 

10-1 
1.43 - 

IQ-^ 
9.83 - 

IQ-^ 
5.63 • 

10-1 

2.83 • 


ACS 

10 “^ 
1.4S - 

10 “^ 
9.83 • 

10 “^ 
5.63 • 

10-1 
3.53 - 


ACS 

10-1 
1.43 - 

10-1 
9.83 - 

10-1 
5.63 • 

10-1 

2.83 • 


CSA 

10“1 
1.98 - 

10“1 
3.80 • 

10“1 
1.18 • 

10-1 
1.58 - 


CSA 

10-1 
2.03 - 

10-1 
3,80 - 

10-1 
1.20 • 

10-1 

1.75 • 


CGA 

10 “^ 
1.60 - 

10 “^ 
4.22 • 

10 “^ 
1,01 • 

10-1 
1.31 - 


CGA 

10-1 
1.27 - 

IQ-^ 
4,22 - 

10-1 
8.44 • 

10-1 

1.13 • 



10“1 

o 

1 

10“1 

10-1 



10-1 

IQ-^ 

10 -^ 

10-1 

P, 1] 

ABT 

1.56 - 

3.80 • 

9.70 • 

1.41 - 

[10, 1] 

ABT 

1.56 - 

3.80 - 

9.70 • 

1.45 • 


ASB 

10“^ 
1.69 - 

10“^ 
3.80 • 

10“^ 
1.03 • 

10-1 
1.52 - 


ASB 

10-1 
1.73 - 

IQ-^ 
3.80 - 

10-^ 
1.05 • 

10-1 

1.61 • 


ADC 

10“1 
1.69 - 

10“^ 
2.24 • 

10“1 
1.20 • 

10-1 
4.27 - 


ADC 

10-1 
1.69 - 

IQ-^ 
2,36 - 

10-1 
1.27 • 

10-1 

3.68 • 


CBO 

10“^ 
1.69 - 

10“^ 
7.05 • 

10“^ 
3.61 • 

IQ-^ 
1.03 - 


CBO 

10-^ 
1.69 - 

10-1 
7,09 - 

10-1 
3.63 • 

10-^ 

7.98 • 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10-1 
1.25 - 


CBl 

10-^ 

0.000 

10-1 

1.000 

10-1 
5.00 • 

10-^ 

9.09 • 


CB2 

0.000 

1.000 

10“^ 
5.00 • 

10-1 
1.25 - 


CB2 

0.000 

1.000 

10-1 
5.00 • 

10-^ 

9.09 • 


ACl 

1.10 - 

4.22 • 

10“1 
7,59 • 

10-1 
1.01 - 


ACl 

9.28 - 

4,22 - 

10-1 
6.75 • 

10-^ 

8.82 • 


AC2 

10“^ 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10-1 
1.25 - 


AC2 

10-^ 
1.27 - 

IQ-^ 
7.22 - 

10-^ 
3.67 • 

10-^ 

7.71 • 


ACS 

1.4S - 

9.83 • 

10“1 
5.63 • 

10-1 
2.48 - 


ACS 

10-^ 
1.43 - 

10-1 
9.83 - 

10-1 
5.63 • 

10-^ 

2.20 • 


CSA 

10“^ 
1.98 - 

10“^ 
3.38 • 

10“^ 
1.16 • 

10-1 
1.78 - 


CSA 

10-1 
1.98 - 

10-1 
2.11 - 

10-1 
1.10 • 

10-1 

1.82 • 


CGA 

10“1 
1.27 - 

10“^ 
4.64 • 

10“1 
8.65 • 

10-1 
1.17 - 


CGA 

10-1 
1.27 - 

IQ-^ 
4.22 - 

10-1 
8.44 • 

10-1 

1.19 • 



10“^ 

o 

1 

10“^ 

10-1 



10-1 

IQ-^ 

10-^ 

10-1 

[25, 1] 

ABT 

1.18 - 

4.64 • 

8.23 • 

1.15 - 

[50, 1] 

ABT 

6.33 - 

5,06 - 

5.70 • 

6.30 • 


ASB 

10“1 
1.56 - 

10“^ 
3.80 • 

10“^ 
9.70 • 

10-1 
1.52 - 


ASB 

10-^ 
1.52 - 

IQ-^ 
4.22 - 

10-^ 
9.70 • 

10-^ 

1.50 • 


ADC 

10“^ 
1.69 - 

10“^ 
2.36 • 

10“^ 
1.27 • 

10-1 
2.53 - 


ADC 

10-1 
1.69 - 

IQ-^ 
2.36 - 

10-^ 
1.27 • 

o . 


CBO 

10“^ 
1.69 - 

10“1 
7.05 • 

10“1 
3.61 • 

IQ-^ 
4.33 - 


CBO 

10-^ 
1.69 - 

10-1 
7.05 - 

10-1 

3.61 

10“^ 

3.04 • 


CBl 

10“^ 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

IQ-^ 
3.85 - 


CBl 

10-^ 

0.000 

IQ-l 

1,000 

10-1 
5.00 • 

10-^ 

1.96 • 


CB2 

0.000 

1.000 

10“1 
5,00 • 

IQ-^ 
3.85 - 


CB2 

0.000 

1.000 

10-1 
5.00 • 

10-^ 

1.96 • 


ACl 

2.11 - 

9.28 • 

10“^ 
5.70 • 

IQ-^ 
2.39 - 


ACl 

1.69 - 

1.05 - 

10-1 

6.12 

10-^ 

1.86 • 


AC2 

10“^ 
1.48 - 

10“^ 
9.41 • 

10“^ 
5.44 • 

IQ-^ 
1.78 - 


AC2 

10-^ 
1.48 - 

10-1 
9.41 - 

10-^ 

5.44 

10-^ 

1.63 • 


ACS 

10“^ 
1.43 - 

10“^ 
9.83 • 

10“^ 
5.63 • 

10-1 
1.76 - 


ACS 

10-1 
1.43 - 

10-1 
9,83 - 

10-1 
5.63 • 

10-1 

1.60 • 


CSA 

10“1 
6.75 - 

10“1 
3.38 • 

10-1 
5.06 • 

10-1 
6.62 - 


CSA 

10-1 
8.02 - 

10-1 
8.44 - 

10-1 
8.23 • 

10-1 

8.03 • 


CGA 

10“^ 
9.28 - 

10“^ 
6.33 • 

10“^ 
7,81 • 

IQ-^ 
9.17 - 


CGA 

10-^ 
5.49 - 

IQ-^ 
8.86 - 

10-^ 

7.17 • 

10-^ 

5.55 • 



1 

o 

o 

1 

10“^ 

10”^ 



o 

1 

1 

o 

o 

1 

to 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg FNR FPR CE NEC 

[100, 1] 

ABT 

2.53 - 

9.70 • 

6.12 • 

2.60 - 




ASB 

10“^ 
1.35 - 

10“^ 
4.22 • 

10“^ 
8.86 • 

10“^ 
1.34 - 




ADC 

10“1 
4.94 - 

10“^ 
3.59 • 

10“^ 
4.26 • 

10“1 
4.92 - 




CBO 

10“1 
1.60 - 

10“1 
6.92 • 

10“1 
4.26 • 

10“1 
1.66 - 




CBl 

10“^ 

0.000 

10“1 
9.41 • 

10“1 
4.70 • 

10“1 
9.32 - 




CB2 

0.000 

10“1 
9.37 • 

10“1 
4.68 • 

10“^ 
9.27 - 




ACl 

1.69 - 

10“^ 
2.66 • 

10“^ 
1.41 • 

10“^ 
1.93 - 




AC2 

10“^ 
1.48 - 

10“1 
9.41 • 

10“1 
5.44 • 

10“^ 
1.56 - 




ACS 

10“^ 
1.43 - 

10“^ 
9.83 • 

10“^ 
5.63 • 

10“^ 
1.52 - 




CSA 

10“1 
3.80 - 

10“1 
1.05 • 

10“1 
7.17 • 

10“1 
3.86 - 




CGA 

10“^ 
4.64 - 

10“^ 
9.28 • 

10“^ 
6.96 • 

10“^ 
4.69 - 





1 

o 

o 

1 

10 “^ 

10 “^ 
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in all the graphs to have a common reference across the representations. 








































Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1, 100] 

ABT 

8.17 - 

2.67 • 

4.22 • 

S.45 - 

[1, 50] 

ABT 

7.SO - 

7,SS - 

4.02 • 

8.62 • 


ASB 

10“1 
7.8S - 

10“^ 
4.67 • 

10“1 
4.15 • 

10“^ 
5.40 - 


ASB 

10“1 
8.2S - 

10“^ 
S.SS - 

10“1 
4.28 • 

10“^ 

4.88 • 


ADC 

10“^ 
9.67 - 

10“^ 

S.SS 

10“^ 
4.85 • 

10“^ 
1.29 - 


ADC 

10“^ 
9.67 - 

10“^ 
s.ss - 

10“^ 
4.85 • 

10“^ 

2.22 • 


CBO 

10“1 
9.67 - 

10“^ 

s.ss 

10“1 
4.85 • 

10“^ 
1.29 - 


CBO 

10“1 
9.67 - 

10“^ 
s.ss - 

10“1 
4.85 • 

10“^ 

2.22 • 


CBl 

10“^ 
9.67 - 

10“^ 

s.ss 

1 

o 

10“^ 
1.29 - 


CBl 

10“^ 
9.67 - 

10“^ 
s.ss - 

10“^ 
4.85 • 

10“^ 

2.22 • 


CB2 

10“1 
9.67 - 

10“^ 

s.ss 

io~i 

4.85 • 

10“^ 
1.29 - 


CB2 

10“1 
9.67 - 

10“^ 
s.ss - 

10“1 
4.85 • 

10“^ 

2.22 • 


ACl 

10“1 
9.67 - 

10“^ 

s.ss 

10“1 
4.85 • 

10“^ 
1.29 - 


ACl 

10“1 
9.67 - 

10“^ 
s.ss - 

10“1 
4.85 • 

10“^ 

2.22 • 


AC2 

10“1 
9.67 - 

10“^ 

s.ss 

10“1 
4.85 • 

10“^ 
1.29 - 


AC2 

10“1 
9.67 - 

10“^ 
s.ss - 

10“1 
4.85 • 

10“^ 

2.22 • 


ACS 

10“1 
9.67 - 

10“^ 

s.ss 

1 

o 

10“^ 
1.29 - 


ACS 

10“1 
9.67 - 

10“^ 
s.ss - 

10“1 
4.85 • 

10“^ 

2.22 • 


CSA 

10“1 
7.90 - 

10“^ 
6.67 • 

10“^ 
4.28 • 

10“^ 
7.S8 - 


CSA 

10“1 
6.77 - 

10“^ 
1.17 - 

10“1 
S.97 • 

10“^ 

1.28 • 


CGA 

10“1 
9.67 - 

10“^ 

S.SS 

10“1 
4.85 • 

10“^ 
1.29 - 


CGA 

10“1 
9.50 - 

10“1 
s.ss - 

10“1 
4.77 • 

10“1 

2.19 • 



10“1 

10“^ 

10“1 

10“^ 



10“1 

10“^ 

10“1 

10“^ 

[1, 25] 

ABT 

6.4S - 

9.67 • 

S.70 • 

1.18 - 

[1, 10] 

ABT 

6.IS - 

l.SS - 

S.7S • 

1.77 • 


ASB 

10“1 
7.80 - 

10“^ 
4.00 • 

• o 

O 1 

10“1 
6.85 - 


ASB 

10“1 
6.8S - 

10“1 
7.00 - 

10“1 
S.77 • 

10“1 

1.26 • 


ADC 

10“1 
s.ss - 

10“^ 
6.70 • 

10“1 
5.02 • 

10“^ 
6.57 - 


ADC 

10“1 
S.SS - 

10“^ 
9.97 - 

10“1 

5.15 

10“1 

9.09 • 


CBO 

10“1 
9.67 - 

10“1 

S.SS 

10“1 
4.85 • 

10“1 
4.04 - 


CBO 

10“^ 
9.67 - 

10“1 
S.SS - 

10“1 
4.85 • 

10”1 

9.09 • 


CBl 

10“^ 
9.7S - 

10“^ 

s.ss 

10“^ 
4.88 • 

10“^ 
4.06 - 


CBl 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 

9.09 • 


CB2 

10“1 
9.8S - 

10“^ 

0.000 

1 

o 

10“^ 
S.78 - 


CB2 

9.97 - 

0.000 

10“1 
4.98 • 

10“^ 

9.06 • 


ACl 

10“^ 
9.67 - 

s.ss 

1 

o 

10“^ 
4.04 - 


ACl 

10“^ 
8.77 - 

2.67 - 

10“^ 
4.52 • 

10“^ 

1.04 • 


AC2 

10“1 
9.9S - 

10“^ 

0.000 

10“^ 
4.97 • 

10“^ 
S.82 - 


AC2 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

10“1 

9.09 • 


ACS 

10“^ 
9.8S - 

s.ss 

10“^ 
4.9S • 

10“^ 
4.10 - 


ACS 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 

9.09 • 


CSA 

10“1 
5.80 - 

10“^ 
1.60 • 

10“1 
S.70 • 

10“^ 
1.76 - 


CSA 

5.00 - 

2.OS - 

10“1 
S.52 • 

10“^ 

2.SO • 


CGA 

10“^ 
8.67 - 

10“^ 
2.67 • 

10“^ 
4.47 • 

10“^ 
5.90 - 


CGA 

10“^ 
6.90 - 

10“^ 
7.00 - 

10“^ 
S.80 • 

10“^ 

1.26 • 



10“1 

10“^ 

10“1 

10“^ 



10“1 

10“^ 

10“1 

10“1 

[1, 7] 

ABT 

6.IS - 

l.SS • 

S.7S • 

1.9S - 

[1. 5] 

ABT 

5.8S - 

1.47 - 

S.65 • 

2.19 • 


ASB 

10“^ 
6.47 - 

10“^ 
1.00 • 

10“^ 
S.7S • 

10“^ 
1.68 - 


ASB 

10“^ 
5.8S - 

10“^ 
1.4S - 

10“^ 
S.6S • 

10“^ 

2.17 • 


ADC 

10“1 
S.SS - 

10“1 
9.97 • 

10“1 
5.15 • 

10“1 
8.76 - 


ADC 

10“1 
4.SS - 

10“1 
9.9S - 

10“1 
5.18 • 

10“1 

8.S5 • 


CBO 

10“^ 
9.67 - 

10“^ 

S.SS 

1 

o 

10“^ 
1.24 - 


CBO 

10“^ 
9.57 - 

10“^ 
6.67 - 

10“^ 
4.82 • 

10“^ 

1.65 • 


CBl 

10“1 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“1 
1.25 - 


CBl 

10“1 
9.97 - 

10“^ 
S.SS - 

10“1 
5.00 • 

10“1 

1.69 • 


CB2 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
1.25 - 


CB2 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 

1.67 • 


ACl 

7.70 - 

5.67 • 

10“1 

4.IS • 

10“1 
1.46 - 


ACl 

6.80 - 

s.ss - 

10“1 
S.82 • 

10“1 
l.SS • 


AC2 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 
1.25 - 


AC2 

10“^ 
9.97 - 

10“^ 

0.000 

10“^ 
4.98 • 

10“^ 

1.66 • 


ACS 

1.000 

0.000 

10“1 
5.00 • 

10“1 
1.25 - 


ACS 

10“1 

1.000 

0.000 

10“1 
5.00 • 

10“1 

1.67 • 


CSA 

4.70 - 

2.07 • 

10“^ 
S.SS • 

10“^ 
2.40 - 


CSA 

4.50 - 

2.20 - 

10“^ 
S.S5 • 

10“^ 

2.58 • 


CGA 

10“1 
6.47 - 

10“1 
1.07 • 

10“1 
S.77 • 

10“1 
1.74 - 


CGA 

10“1 
5.6S - 

10“1 
1.50 - 

10“1 
S.57 • 

10“1 

2.19 • 



10“^ 

10 “^ 

10 “^ 

10 “^ 



10 “^ 

10 “^ 

10 “^ 

10 “^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1,3] 

ABT 

5.17 - 

1.87 • 

S.52 • 

2.69 - 

[1.2] 

ABT 

5.10 - 

1.90 - 

S.50 • 

2.97 • 


ASB 

10“1 
4.90 - 

10“1 
1.8S • 

10“1 
S.S7 • 

10“1 
2.60 - 


ASB 

10“1 
4.40 - 

10“1 
2,50 - 

10“1 
S.45 • 

10“1 

S.IS • 


ADC 

10“1 
1.4S - 

10“1 
9.50 • 

10“1 
5.47 • 

10“1 
7.48 - 


ADC 

10“1 
1.4S - 

10“1 
9.50 - 

10“1 
5.47 • 

10“1 

6.81 • 


CBO 

10“1 
9.67 - 

10“1 

s.ss 

1 

o 

10“1 
2.44 - 


CBO 

10“1 
9.67 - 

10“1 
S.SS - 

10“1 
4.85 • 

10“1 

S.24 • 


CBl 

10“1 
9.9S - 

10“^ 

s.ss 

10“^ 
4.98 • 

10“1 
2.51 - 


CBl 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

10”1 

S.SS • 


CB2 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

10“1 
2.50 - 


CB2 

1.000 

0,000 

10“1 
5.00 • 

10“1 
s.ss • 


ACl 

5.27 - 

1.77 • 

10“^ 
S.52 • 

10“^ 
2.64 - 


ACl 

4. OS - 

2,27 - 

10“^ 

S.15 

10“^ 

2.86 • 


AC2 

10“1 

1.000 

10“1 

0.000 

10“1 
5.00 • 

10“1 
2.50 - 


AC2 

10“1 

1.000 

10“1 

0.000 

10“1 
5.00 • 

10“1 

S.SS • 


ACS 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
2.50 - 


ACS 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
s.ss • 


CSA 

4.07 - 

2.70 • 

10“1 
S.SS • 

10“1 
S.04 - 


CSA 

S.77 - 

S.OS - 

10“1 
S.40 • 

10“1 
s .28 • 


CGA 

10“^ 
4.8S - 

10“^ 
1.90 • 

10“^ 
S.S7 • 

10“^ 
2.6S - 


CGA 

10“^ 
4.SS - 

10“^ 
2.6S - 

10“^ 
S.48 • 

10“^ 

S.20 • 



10“1 

10“1 

10“1 

10“1 



10“1 

10“1 

10“1 

10“1 

[2,3] 

ABT 

S.IS - 

S.47 • 

S.SO • 

S.SS - 

[1. 1] 

ABT 

2.77 - 

S.80 - 

S.28 • 

S.28 • 


ASB 

10“^ 
S.60 - 

10“^ 
S.OS • 

10“^ 
S.S2 • 

10“^ 
S.26 - 


ASB 

10“^ 
2.9S - 

10“^ 
S.60 - 

10“^ 
S.27 • 

10“^ 

S.27 • 


ADC 

10“1 
5.S7 - 

10“1 

7.17 • 

10“1 
6.27 • 

10“1 
6.45 - 


ADC 

10“1 
8.00 - 

10“1 
5,50 - 

10“1 
6.75 • 

10“1 

6.75 • 


CBO 

10“^ 
9.67 - 

10“^ 
6.67 • 

10“^ 
4.87 • 

10“^ 
S.91 - 


CBO 

10“^ 
2.00 - 

10“^ 
4.50 - 

10“^ 
S.25 • 

10“^ 

S.25 • 


CBl 

10“1 
9.9S - 

10“^ 

S.SS 

1 

o 

10“1 
S.99 - 


CBl 

10“1 
8.00 - 

10“1 
5.50 - 

10“1 
6.75 • 

10“1 

6.75 • 


CB2 

10“^ 
9.97 - 

10“^ 

0.000 

1 

o 

10“^ 
S.99 - 


CB2 

10“^ 
2.9S - 

10“^ 
S.60 - 

10“^ 
S.27 • 

10“^ 

S.27 • 


ACl 

10“1 
S.47 - 

2.7S • 

10“1 
S.IO • 

10“1 
S.OS - 


ACl 

10“1 
2.8S - 

10“1 
S,50 - 

10“1 

S.17 

10“1 

S.17 • 


AC2 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 
4.00 - 


AC2 

10“^ 
2.9S - 

10“^ 
S.60 - 

10“^ 
S.27 • 

10“^ 

S.27 • 


ACS 

9.8S - 

S.SS 

10“1 
4.9S • 

10“1 
S.95 - 


ACS 

10“1 
2.8S - 

10“1 
S.50 - 

10“1 
S.17 • 

10“1 

S.17 • 


CSA 

10“^ 
S.SO - 

10“^ 
S.27 • 

10“^ 
S.28 • 

10“^ 
S.28 - 


CSA 

10“^ 
2.9S - 

10“^ 
S.60 - 

10“^ 
S.27 • 

10“^ 

S.27 • 


CGA 

10“1 
S.77 - 

10“1 

S.IS 

10“1 
S.45 • 

10“1 
S.S9 - 


CGA 

10“1 
2.9S - 

10“1 
S.60 - 

10“1 
S.27 • 

10“1 

S.27 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 

[3,2] 

ABT 

2.40 - 

4.5S • 

S.47 • 

S.25 - 

[2. 1] 

ABT 

2.SS - 

4.67 - 

S.50 • 

S.ll • 


ASB 

10“1 
2.57 - 

10“1 
4.S7 • 

10“1 
S.47 • 

10“1 
S.29 - 


ASB 

10“1 
2.27 - 

10“1 
4.80 - 

10“1 
S.5S • 

10“1 

S.ll • 


ADC 

10“^ 

8.IS - 

10“^ 
5.20 • 

10“^ 
6.67 • 

10“^ 
6.96 - 


ADC 

10“^ 
8.27 - 

10“^ 
4,97 - 

10“^ 
6.62 • 

10“^ 

7.17 • 


CBO 

10“1 

0.000 

10“1 
9.9S • 

10“1 
4.97 • 

10“1 
S.97 - 


CBO 

10“1 

0.000 

10“1 
9,97 - 

10“1 
4.98 • 

10“1 

S.S2 • 


CBl 

0.000 

10“^ 
9.97 • 

10“^ 
4.98 • 

10“^ 
S.99 - 


CBl 

0.000 

10“^ 

1,000 

10“^ 
5.00 • 

10“^ 

S.SS • 


CB2 

0.000 

10“1 
9.97 • 

1 

o 

10“1 
S.99 - 


CB2 

0.000 

1.000 

10“1 
5.00 • 

10“1 
s.ss • 


ACl 

2.20 - 

10“^ 
S.90 • 

10“^ 
S.05 • 

10“^ 
2.88 - 


ACl 

1.67 - 

4,60 - 

10“^ 

S.IS 

10“^ 

2.64 • 


AC2 

10“1 

0.000 

10“1 
9.9S • 

10“1 
4.97 • 

10“1 
S.97 - 


AC2 

10“1 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 

S.SS • 


ACS 

0.000 

10“^ 
9.97 • 

10“^ 
4.98 • 

10“^ 
S.99 - 


ACS 

0.000 

9,97 - 

10“^ 
4.98 • 

10“^ 

S.S2 • 


CSA 

2.67 - 

10“1 

4. IS • 

10“1 
S.40 • 

10“1 
S.25 - 


CSA 

2.57 - 

10“1 
4.40 - 

10“1 
S.48 • 

10“1 

S.18 • 


CGA 

10“^ 
2.57 - 

10“^ 
4.SS • 

10“^ 
S.45 • 

10“^ 
S.27 - 


CGA 

10“^ 
2.20 - 

10“^ 
4.77 - 

10“^ 
S.48 • 

10“^ 

S.06 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“1 

10“1 

10 “^ 

10 “^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[3, 1] 

ABT 

2.SO - 

4.67 • 

S.48 • 

2.89 - 

[5, 1] 

ABT 

l.SO - 

5.87 - 

S.58 • 

2.06 • 


ASB 

10“1 
1.70 - 

10“1 

5.SO • 

10“1 
S.50 • 

10“1 
2.60 - 


ASB 

10“1 
1.20 - 

10“1 
5.87 - 

10“1 
S.5S • 

10“1 

1.98 • 


ADC 

10“1 
9.4S - 

10“1 
1.5S • 

10“1 
5.48 • 

10“1 
7.46 - 


ADC 

10“1 

1.000 

10“1 
6.67 - 

10“1 

5.OS • 

10“1 

8.S4 • 


CBO 

10“1 

0.000 

10“1 
9.9S • 

• o 

10“1 
2.48 - 


CBO 

0.000 

10“^ 
9.9S - 

10“1 
4.97 • 

10“1 

1.66 • 


CBl 

0.000 

10“1 

1.000 

10“^ 
5.00 • 

10“1 
2.50 - 


CBl 

0.000 

10“1 
9.97 - 

10“1 
4.98 • 

10“1 

1.66 • 


CB2 

0.000 

1.000 

10“1 
5.00 • 

10“1 
2.50 - 


CB2 

0.000 

10“1 
9,97 - 

10“1 
4.98 • 

10“1 

1.66 • 


ACl 

1.2S - 

5.17 • 

10“^ 
S.20 • 

10“^ 
2.22 - 


ACl 

8.SS - 

10“^ 
6,20 - 

10“^ 
S.52 • 

10“^ 

1.7S • 


AC2 

10“1 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
2.50 - 


AC2 

10“^ 

0.000 

10“1 
9.97 - 

10“1 
4.98 • 

10“1 

1.66 • 


ACS 

0.000 

9.97 • 

10“^ 
4.98 • 

10“^ 
2.49 - 


ACS 

0.000 

10“^ 
9.97 - 

10“^ 
4.98 • 

10“^ 

1.66 • 


CSA 

2.S7 - 

10“1 
4.70 • 

10“1 
S.5S • 

10“1 
2.95 - 


CSA 

2.OS - 

10“1 
4,97 - 

10“1 
S.50 • 

10“1 

2.52 • 


CGA 

10“^ 
1.70 - 

10“^ 
5.20 • 

10“^ 
S.45 • 

10“^ 
2.58 - 


CGA 

10“^ 
l.is - 

10“^ 
5.87 - 

10“^ 
S.50 • 

10“^ 

1.92 • 



10“1 

10“1 

10“1 

10“1 



10“1 

10“1 

10“1 

10“1 

P, 1] 

ABT 

l.OS - 

6.SS • 

S.68 • 

1.70 - 

[10, 1] 

ABT 

8.00 - 

6.9S - 

S.87 • 

1.S6 • 


ASB 

10“^ 
1.00 - 

10“^ 
6.SS • 

10“^ 
S.67 • 

10“^ 
1.67 - 


ASB 

10“^ 
8.SS - 

10“^ 
6.97 - 

10“^ 
S.90 • 

10”^ 

1.S9 • 


ADC 

10“1 

1.000 

10“1 
6.67 • 

10“1 

5.OS • 

10“1 
8.76 - 


ADC 

10“^ 

1.000 

10“1 
6,67 - 

10“1 

5.OS • 

10“1 

9.10 • 


CBO 

0.000 

10“^ 
9.9S • 

10“^ 
4.97 • 

10“^ 
1.24 - 


CBO 

0.000 

10“^ 
9,9S - 

10“^ 
4.97 • 

10“^ 

9.OS • 


CBl 

0.000 

10“1 
9.97 • 

10“1 
4.98 • 

10“1 
1.25 - 


CBl 

0.000 

10“1 
9.9S - 

10“1 
4.97 • 

10“^ 

9.OS • 


CB2 

0.000 

10“^ 
9.97 • 

10“^ 
4,98 • 

10“^ 
1.25 - 


CB2 

0.000 

10“^ 
9.9S - 

10“^ 
4.97 • 

10“^ 

9.OS • 


ACl 

5.00 - 

10“1 

7.OS • 

10“1 
S.77 • 

10“1 
1.S2 - 


ACl 

2.SS - 

10“1 
7,80 - 

10“1 
4.02 • 

10“^ 

9.21 • 


AC2 

10“^ 

0.000 

10“^ 
9.9S • 

10“^ 
4.97 • 

10“^ 
1.24 - 


AC2 

10“^ 

0.000 

10“^ 
9,97 - 

10“^ 
4.98 • 

10“^ 

9.06 • 


ACS 

0.000 

10“1 
9.97 • 

1 

o 

10“1 
1.25 - 


ACS 

0.000 

10“1 
9.97 - 

10“1 
4.98 • 

10“^ 

9.06 • 


CSA 

1.97 - 

10“^ 
4.97 • 

10“^ 
S.47 • 

10“^ 
2.S4 - 


CSA 

1.77 - 

10“^ 
5.2S - 

10“^ 
S.50 • 

10“^ 

2.08 • 


CGA 

10“1 
1.07 - 

10“1 
6.S7 • 

10“1 
S.72 • 

10“1 
1.7S - 


CGA 

10“1 
7.67 - 

10“1 
6,7S - 

10“1 
S.75 • 

10“1 
l.Sl • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 

[25, 1] 

ABT 

6.67 - 

6.9S • 

S.80 • 

9.08 - 

[50, 1] 

ABT 

4.00 - 

7,50 - 

S.95 • 

5.S9 • 


ASB 

10“^ 
4.00 - 

10“1 
7.6S • 

10“1 
4.02 • 

10“^ 
6.78 - 


ASB 

10“^ 
S.SS - 

10“1 
7.97 - 

10“1 
4.15 • 

10“^ 

4.8S • 


ADC 

10“^ 

1.000 

10“^ 
6.67 • 

10“^ 

5.OS • 

10“^ 
9.62 - 


ADC 

10“^ 

1.000 

10“^ 
6.67 - 

10“^ 

5.OS • 

10“^ 

9.81 • 


CBO 

0.000 

10“^ 
9.9S • 

10“1 
4.97 • 

10“1 
S.82 - 


CBO 

0.000 

10“^ 
9,9S - 

10“1 
4.97 • 

10“1 

1.95 • 


CBl 

0.000 

10“^ 
9.9S • 

10“^ 
4.97 • 

10“^ 
S.82 - 


CBl 

0.000 

10“^ 
9,9S - 

10“^ 
4.97 • 

10“^ 

1.95 • 


CB2 

0.000 

10“1 
9.9S • 

10“1 
4.97 • 

10“^ 
S.82 - 


CB2 

0.000 

10“1 
9.9S - 

10“1 
4.97 • 

10“^ 

1.95 • 


ACl 

0.000 

10“^ 
9.57 • 

10“^ 
4.78 • 

10“^ 
S.68 - 


ACl 

0.000 

10“^ 
9.97 - 

10“^ 
4.98 • 

10“^ 

1.95 • 


AC2 

0.000 

10“1 
9.97 • 

10“1 
4,98 • 

10“^ 
S.8S - 


AC2 

0.000 

10“1 
9,97 - 

10“1 
4.98 • 

10“^ 

1.95 • 


ACS 

0.000 

10“^ 
9.9S • 

10“^ 
4.97 • 

10“^ 
S.82 - 


ACS 

0.000 

10“^ 
9,9S - 

10“^ 
4.97 • 

10“^ 

1.95 • 


CSA 

1.20 - 

10“1 
5.6S • 

10“1 
S.42 • 

10“^ 
1.S7 - 


CSA 

9.SS - 

10“1 
6.20 - 

10“1 
S.57 • 

10“^ 

1.04 • 


CGA 

10“^ 
2.00 - 

10“^ 
8.5S • 

10“^ 
4.S7 • 

10“^ 
5.21 - 


CGA 

10“^ 

0.000 

10“^ 
9.6S - 

10“^ 
4.82 • 

10“^ 

1.89 • 



10“^ 

10“^ 

10“1 

10“^ 




10 “^ 

10“1 

10 “^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC Cost Alg FNR FPR CE NEC 

[100, 1] 

ABT 

3.00 - 

8.13 • 

4.22 • 

3.78 - 



1 

o 

10“1 

10“1 

10 “^ 


ASB 

4.00 - 

7.60 • 

4,00 • 

4.71 - 



10 “^ 

10“1 

10“1 

10 “^ 


ADC 

3.33 - 

6.67 • 

5.00 • 

3.37 - 



10“1 

10“1 

10“1 

10“1 


CBO 

0.000 

9.93 • 

4.97 • 

9.83 - 




10“1 

10“1 

10 “^ 


CBl 

0.000 

9.93 • 

4.97 • 

9.83 - 




10“1 

10“1 

10 “^ 


CB2 

0.000 

9.93 • 

4.97 • 

9.83 - 




10 “^ 

10 “^ 

10 “^ 


ACl 

0.000 

9.93 • 

4.97 • 

9.83 - 




10“1 

10“1 

10 “^ 


AC2 

0.000 

9.93 • 

4.97 • 

9.83 - 




10 “^ 

10 “^ 

10 “^ 


ACS 

0.000 

9.93 • 

4.97 • 

9.83 - 




10“1 

10“1 

10 “^ 


CSA 

5.67 - 

7.60 • 

4,08 • 

6.36 - 



10 “^ 

10 “^ 

10 “^ 

10 “^ 


CGA 

0.000 

9.93 • 

4.97 • 

9.83 - 




10“1 

10“1 

10 “^ 




Table A-4: 
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in all the graphs to have a common reference across the representations. 






































Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1, 100] 

ABT 

5.54 - 

1.16 • 

S.S5 • 

1.20 - 

[1, 50] 

ABT 

4.98 - 

1.57 - 

S.28 • 

1.64 • 


ASB 

10“1 
5.92 - 

10“1 
9.74 • 

10“1 
S.45 • 

10“1 
1.02 - 


ASB 

10“1 
6.14 - 

10“1 
9,S6 - 

10“1 
S.54 • 

10“1 

1.04 • 


ADC 

10“^ 
9.55 - 

10“^ 
1.50 • 

1 

o 

10“^ 
2.4S - 


ADC 

10“^ 
6.29 - 

10“^ 
S.41 - 

10“^ 
4.85 • 

10“^ 

S.46 • 


CBO 

10“1 
9.55 - 

10“^ 
1.50 • 

10“^ 
4,85 • 

10“^ 
2.4S - 


CBO 

10“1 
9.55 - 

10“1 
1.50 - 

10“1 
4.85 • 

10“1 

S.S4 • 


CBl 

10“^ 
9.55 - 

10“^ 
1.50 • 

1 

o 

10“^ 
2.4S - 


CBl 

10“^ 
9.59 - 

10“^ 
1.12 - 

10“^ 
4.85 • 

10“^ 

2.98 • 


CB2 

10“1 
9.55 - 

10“^ 
1.50 • 

io~i 

4,85 • 

10“^ 
2.4S - 


CB2 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

10“^ 

1.96 • 


ACl 

10“1 
9.55 - 

10“^ 
1.50 • 

10“1 
4,85 • 

10“^ 
2.4S - 


ACl 

9.55 - 

1.50 - 

10“1 
4.85 • 

10“^ 

S.S4 • 


AC2 

10“1 
9.55 - 

10“^ 
1.50 • 

10“1 
4,85 • 

10“^ 
2.4S - 


AC2 

10“1 
9.55 - 

10“^ 
1.50 - 

10“1 
4.85 • 

10“^ 

S.S4 • 


ACS 

10“1 
9.55 - 

10“^ 
1.50 • 

1 

o 

10“^ 
2.4S - 


ACS 

10“1 
9.55 - 

10“^ 
1.50 - 

10“1 
4.85 • 

10“^ 

S.S4 • 


CSA 

10“1 

6.OS - 

10“^ 
8.99 • 

10“^ 
S,46 • 

10“^ 
9.50 - 


CSA 

10“1 
4.64 - 

10“^ 
1.54 - 

10“1 
S.09 • 

10“^ 

1.60 • 


CGA 

10“1 

9.OS - 

10“^ 
1.50 • 

1 

o 

10“^ 
2.S8 - 


CGA 

10“1 
7.5S - 

10“1 
4.12 - 

10“1 
S.97 • 

10“1 

5.52 • 



10“1 

10 “^ 

10 “^ 

10 “^ 



10“1 

1 

o 

10“1 

10 “^ 

[1, 25] 

ABT 

4.SI - 

1.95 • 

S,1S • 

2.04 - 

[1, 10] 

ABT 

S.97 - 

2.21 - 

S.09 • 

2.S7 • 


ASB 

10“1 

6 .OS - 

10“1 
1.05 • 

10“1 
S,54 • 

10“1 
1.24 - 


ASB 

10“1 
5.47 - 

10“1 
1.46 - 

10“1 
S.46 • 

10“1 

1.82 • 


ADC 

10“1 
2.96 - 

10“1 
6.74 • 

10“1 
4,85 • 

10“1 
6.60 - 


ADC 

10“1 
2.51 - 

10“1 
6.78 - 

10“1 
4.64 • 

10“1 

6.S9 • 


CBO 

10“1 
9.55 - 

10“1 
1.50 • 

10“1 
4,85 • 

10“1 
5.11 - 


CBO 

10“1 
9.10 - 

10“1 
1.87 - 

10“1 
4.64 • 

10“1 

9.98 • 


CBl 

10 “^ 
9.78 - 

10 “^ 

0.000 

10 “^ 
4,89 • 

10 “^ 
S.76 - 


CBl 

10 “^ 

1.000 

10 “^ 

0,000 

10 “^ 
5.00 • 

10 “^ 

9.09 • 


CB2 

10“1 

1.000 

0.000 

10“1 
5,00 • 

10 “^ 
S.85 - 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10 “^ 

9.09 • 


ACl 

8.S5 - 

2.25 • 

10 “^ 
4,29 • 

10 “^ 
5.S7 - 


ACl 

6.40 - 

5.24 - 

10 “^ 
S.46 • 

10 “^ 

1.06 • 


AC2 

10“1 

1.000 

10 “^ 

0.000 

10“1 
5.00 • 

10 “^ 
S.85 - 


AC2 

10“1 

1.000 

10 “^ 
S.75 - 

10“1 
5.02 • 

10“1 

9.4S • 


ACS 

1.000 

0.000 

10 “^ 
5.00 • 

10 “^ 
S.85 - 


ACS 

1.000 

10 “^ 

0,000 

10 “^ 
5.00 • 

10 “^ 

9.09 • 


CSA 

4.08 - 

1.69 • 

10“1 
2.88 • 

10 “^ 
1.78 - 


CSA 

S.71 - 

2.21 - 

10“1 
2.96 • 

10 “^ 

2.S5 • 


CGA 

10 “^ 
6.48 - 

10 “^ 
7.87 • 

10 “^ 
S.6S • 

10 “^ 
1.01 - 


CGA 

10 “^ 
5.24 - 

10 “^ 
1.42 - 

10 “^ 

s.ss 

10“^ 

1.77 • 



10“1 

o 

1 

10“1 

10“1 



10“1 

10“1 

10“1 

10“1 

[1, 7] 

ABT 

S.82 - 

2.21 • 

S.Ol • 

2.41 - 

[1. 5] 

ABT 

S.67 - 

2,S6 - 

S.Ol 

2.58 • 


ASB 

10“^ 

5.IS - 

10 “^ 
1.76 • 

10“^ 
S.45 • 

10 “^ 
2.18 - 


ASB 

10“^ 
4.68 - 

10 “^ 
1.72 - 

10 “^ 
S.20 • 

10“^ 

2.22 • 


ADC 

10“1 
4.42 - 

10“1 
6.59 • 

10“1 
5.51 • 

10“1 
6.S2 - 


ADC 

10“1 
4.42 - 

10“1 
6.59 - 

10“1 

5.51 

10“1 

6.2S • 


CBO 

10“^ 
9.55 - 

10 “^ 
1.50 • 

1 

o 

10 “^ 
1.S2 - 


CBO 

10“^ 
9.55 - 

10 “^ 
1.50 - 

10“^ 
4.85 • 

10“^ 

1.72 • 


CBl 

10“1 

1.000 

10“^ 

0.000 

10 “^ 
5.00 • 

10“1 
1.25 - 


CBl 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

10“1 

1.67 • 


CB2 

9.9S - 

0.000 

10“^ 
4,96 • 

10 “^ 
1.24 - 


CB2 

9.85 - 

0.000 

10 “^ 
4.9S • 

10 “^ 

1.64 • 


ACl 

10“1 
5.54 - 

8.99 • 

10“1 
S.22 • 

10“1 
1.48 - 


ACl 

10“1 
5.02 - 

1.20 - 

10“1 

S.ll 

10“1 

1.84 • 


AC2 

10 “^ 

1.000 

10 “^ 
S.75 • 

10 “^ 
5,02 • 

10 “^ 
1.28 - 


AC2 

10 “^ 
9.96 - 

10 “^ 
7,49 - 

10 “^ 
5.02 • 

10 “^ 

1.72 • 


ACS 

1.000 

10 “^ 

0.000 

10“1 
5.00 • 

10“1 
1.25 - 


ACS 

10“1 
9.9S - 

10 “^ 

0.000 

10“1 
4.96 • 

10“1 

1.65 • 


CSA 

S.56 - 

2.4S • 

10 “^ 
S.OO • 

10 “^ 
2.57 - 


CSA 

10 “^ 
S.48 - 

2.4S - 

10 “^ 
2.96 • 

10 “^ 

2.61 • 


CGA 

10“1 
4.91 - 

10“1 
1.69 • 

10“1 
S.SO • 

10“1 
2.09 - 


CGA 

10“1 
4.64 - 

10“1 
1.87 - 

10“1 
S.26 • 

10“1 

2.SS • 



10 “^ 

10 “^ 

10 “^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1,3] 

ABT 

S.6S - 

2.58 • 

S.ll • 

2.85 - 

[1.2] 

ABT 

S.S7 - 

2.7S - 

S.OS • 

2.95 • 


ASB 

10“1 
4.04 - 

10“1 
2.10 • 

10“1 
s.07 • 

10-1 
2.58 - 


ASB 

10-1 
S.67 - 

10-1 
2.28 - 

10-1 
2.98 • 

10-1 

2.75 • 


ADC 

10“1 
4.61 - 

10“1 
6.59 • 

10“1 
5.60 • 

10-1 
6.10 - 


ADC 

10-1 
S.97 - 

10-1 
9.14 - 

10-1 
6.55 • 

10-1 

7.42 • 


CBO 

10“1 
9.59 - 

o ■ 

1 

o 

10-1 
2.48 - 


CBO 

10-1 
9.55 - 

o . 

10-1 
4.8S • 

10-1 

S.26 • 


CBl 

10“1 

1.000 

10 “^ 

0.000 

10 “^ 
5.00 • 

10-1 
2.50 - 


CBl 

10-1 

1.000 

10 “^ 

0.000 

10-1 
5.00 • 

10-1 

S.SS • 


CB2 

9.85 - 

0.000 

10“1 
4.9S • 

10-1 
2.46 - 


CB2 

1.000 

0.000 

10-1 
5.00 • 

10-1 
s.ss • 


ACl 

10“^ 
4.42 - 

1.69 • 

10“^ 
S.05 • 

10-1 
2.S7 - 


ACl 

S.78 - 

2.06 - 

10-1 
2.92 • 

10-1 

2.6S • 


AC2 

10“1 

1.000 

10“1 
S.75 • 

10“1 
5.02 • 

10-1 
2.5S - 


AC2 

10-1 

1.000 

10-1 

0.000 

10-1 
5.00 • 

10-1 

S.SS • 


ACS 

9.9S - 

10“^ 

0.000 

10“^ 
4.96 • 

10-1 
2.48 - 


ACS 

1.000 

S.75 - 

10-1 
5.02 • 

10-1 

S.SO • 


CSA 

10“1 
S.26 - 

2.66 • 

10“1 
2.96 • 

10-1 
2.81 - 


CSA 

S.07 - 

IQ-^ 
2.81 - 

10-1 
2.94 • 

10-1 

2.90 • 


CGA 

10“^ 
4.08 - 

10“^ 
2.17 • 

10“^ 
S.IS • 

10-1 
2.65 - 


CGA 

10-1 
S.78 - 

IQ-l 
2.4S - 

10-1 

S.ll 

10-1 

2.88 • 



10“1 

10“1 

10“1 

10-1 



10-1 

10-1 

10-1 

10-1 

[2,3] 

ABT 

S.S7 - 

2.7S • 

S.05 • 

2.99 - 

[1. 1] 

ABT 

S.22 - 

S.07 - 

s.15 

S.15 • 


ASB 

10“^ 
S.41 - 

10“^ 
2.58 • 

10“^ 
S.OO • 

10-1 
2.91 - 


ASB 

10-1 
S.OS - 

IQ-l 
S.ll - 

10-1 
s.07 • 

10-1 

S.07 • 


ADC 

10“1 
4.08 - 

10“1 
8.99 • 

10“1 
6.54 • 

10-1 

7.OS - 


ADC 

10-1 
7.5S - 

10-1 
6.52 - 

10-1 
7.02 • 

10-1 

7.02 • 


CBO 

10“^ 
9.55 - 

o ■ 

10“^ 
4.8S • 

10-1 
S.89 - 


CBO 

10-1 
2.47 - 

IQ-l 
S.48 - 

10-1 
2.98 • 

10-1 

2.98 • 


CBl 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

10-1 
4.00 - 


CBl 

10-1 
7.45 - 

10-1 
6.59 - 

10-1 
7.02 • 

10-1 

7.02 • 


CB2 

1.000 

0.000 

10“^ 
5.00 • 

10-1 
4.00 - 


CB2 

10-1 
S.OS - 

10-1 
S.ll - 

10-1 
S.07 • 

10-1 

S.07 • 


ACl 

S.41 - 

2.40 • 

10“1 
2.90 • 

10-1 
2.80 - 


ACl 

10-1 
2.88 - 

10-1 
S.OO - 

10-1 
2.94 • 

10-1 

2.94 • 


AC2 

10“^ 

1.000 

10“^ 
S.75 • 

10“^ 
5.02 • 

10-1 
4.02 - 


AC2 

10-1 
S.OS - 

IQ-l 
S.ll - 

10-1 
S.07 • 

10-1 

S.07 • 


ACS 

9.96 - 

10“^ 
S.75 • 

10“1 
5.00 • 

10-1 
4.01 - 


ACS 

10-1 
2.88 - 

10-1 
S.OO - 

10-1 
2.94 • 

10-1 

2.94 • 


CSA 

10“^ 
S.OS - 

10“^ 
S.07 • 

10“^ 
S.05 • 

10-1 
S.06 - 


CSA 

10-1 
S.OS - 

10-1 
S.ll - 

10-1 
S.07 • 

10-1 

S.07 • 


CGA 

10“1 
S.45 - 

10“1 
2.7S • 

10“1 
S.09 • 

10-1 
S.02 - 


CGA 

10-1 
S.OS - 

10-1 
S.ll - 

10-1 
S.07 • 

10-1 

S.07 • 



10“^ 

10“^ 

10“^ 

10-1 



10-1 

10-1 

10-1 

10-1 

[3,2] 

ABT 

2.96 - 

s.ss 

S.15 • 

S.ll - 

[2. 1] 

ABT 

2.70 - 

S.52 - 

S.ll 

2.97 • 


ASB 

10“1 
2.66 - 

10“1 
S.S7 • 

10“1 
S.Ol • 

10-1 
2.94 - 


ASB 

10-1 
2.S2 - 

10-1 
S.60 - 

10-1 
2.96 • 

10-1 

2.75 • 


ADC 

10“^ 

8.SI - 

10“^ 
5.S6 • 

10“^ 
6.84 • 

10-1 

7.IS - 


ADC 

10-1 
8.4S - 

10-1 
4.42 - 

10-1 

6.42 

10-1 

7.09 • 


CBO 

10“1 

0.000 

10“1 
9.96 • 

1 

o 

10-1 
S.99 - 


CBO 

10-1 
S.75 - 

10-1 
9.96 - 

10-1 
5.00 • 

10-1 

S.S5 • 


CBl 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10-1 
4.00 - 


CBl 

10-^ 

0.000 

IQ-l 

1.000 

10-1 
5.00 • 

10-1 

S.SS • 


CB2 

0.000 

1.000 

10“1 
5.00 • 

10-1 
4.00 - 


CB2 

0.000 

9.96 - 

10-1 
4.98 • 

10-1 

S.S2 • 


ACl 

2.S6 - 

S.52 • 

10“^ 
2.94 • 

10-1 
2.82 - 


ACl 

2.IS - 

10-1 
S.6S - 

10-1 
2.88 • 

10-1 

2.6S • 


AC2 

10“1 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10-1 
4.00 - 


AC2 

10-1 

0.000 

10-1 

1.000 

10-1 
5.00 • 

10-1 

S.SS • 


ACS 

0.000 

1.000 

10“^ 
5.00 • 

10-1 
4.00 - 


ACS 

0.000 

1.000 

10-1 
5.00 • 

10-1 
s.ss • 


CSA 

2.88 - 

S.OS • 

10-1 
2.96 • 

10-1 
2.94 - 


CSA 

2.77 - 

S.SO - 

10-1 
S.OS • 

10-1 

2.95 • 


CGA 

10“^ 
2.40 - 

10“^ 
S.SO • 

10“1 
2.85 • 

10-1 
2.76 - 


CGA 

10-1 
2.25 - 

10-1 
S.82 - 

10-1 
S.OS • 

10-1 

2.77 • 



10“1 

10“^ 

10-1 

10-1 



10-1 

10-1 

10-1 

10-1 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[3, 1] 

ABT 

2.4S - 

S.60 • 

S.Ol • 

2.72 - 

[5. 1] 

ABT 

2.06 - 

S.97 - 

S.Ol 

2.S8 • 


ASB 

10“1 
1.84 - 

10“1 
4.12 • 

10“1 
2.98 • 

10“1 
2.41 - 


ASB 

10“1 
1.65 - 

10“1 
4.72 - 

10“1 
S.18 • 

10“1 

2.16 • 


ADC 

10“1 
9.21 - 

10“1 

S.15 

10“1 
6.18 • 

10“1 
7.70 - 


ADC 

10“1 
9.S6 - 

10“1 
2,58 - 

10“1 
5.97 • 

10“1 

8.2S • 


CBO 

10“1 
S.75 - 

10“1 
9.96 • 

10“1 
5.00 • 

10“1 
2.52 - 


CBO 

10“1 
S.75 - 

10“1 
9.96 - 

10“1 
5.00 • 

10“1 

1.69 • 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
2.50 - 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 

1.67 • 


CB2 

0.000 

9.96 • 

10“1 
4.98 • 

10“1 
2.49 - 


CB2 

0.000 

9.81 - 

10“1 
4.91 • 

10“1 

1.64 • 


ACl 

1.72 - 

10“^ 
4.01 • 

10“^ 
2.87 • 

10“^ 
2.29 - 


ACl 

1.24 - 

10“^ 
4.5S - 

10“^ 
2.88 • 

10“^ 

1.79 • 


AC2 

10“1 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
2.50 - 


AC2 

10“1 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 

1.67 • 


ACS 

0.000 

1.000 

10“^ 
5.00 • 

10“^ 
2.50 - 


ACS 

0.000 

1.000 

10“^ 
5.00 • 

10“^ 

1.67 • 


CSA 

2.70 - 

S.41 • 

10“1 
S.05 • 

10“1 
2.87 - 


CSA 

2.58 - 

S,45 - 

10“1 

S.Ol 

10“1 

2.7S • 


CGA 

10“^ 
1.76 - 

10“^ 
4.04 • 

10“^ 
2.90 • 

10“^ 
2.SS - 


CGA 

10“^ 
1.57 - 

10“^ 
4.5S - 

10“^ 
s.05 • 

10“^ 

2.07 • 



10“1 

10“1 

10“1 

10“1 



10“1 

10“1 

10“1 

10“1 

P, 1] 

ABT 

1.80 - 

4.19 • 

S.OO • 

2.10 - 

[10, 1] 

ABT 

1.80 - 

4.19 - 

S.OO • 

2.02 • 


ASB 

10“^ 
1.42 - 

10“^ 
4.8S • 

10“^ 
S.IS • 

10“^ 
1.85 - 


ASB 

o . 

10“^ 

5.IS - 

10“^ 

S.IS 

10”^ 

1.49 • 


ADC 

10“1 
9.81 - 

10“1 
1.S5 • 

10“1 
5.58 • 

10“1 
8.75 - 


ADC 

10“^ 
9.89 - 

10“1 
1.42 - 

10“1 
5.66 • 

10“1 

9.12 • 


CBO 

10“^ 
S.75 - 

10“^ 
9.96 • 

10“^ 
5.00 • 

10“^ 
1.28 - 


CBO 

10“^ 
S.75 - 

10“^ 
9,96 - 

10“^ 
5.00 • 

10“^ 

9.40 • 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
1.25 - 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“^ 

9.09 • 


CB2 

0.000 

1.000 

10“^ 
5.00 • 

10“^ 
1.25 - 


CB2 

0.000 

1.000 

10“^ 
5.00 • 

10“^ 

9.09 • 


ACl 

1.09 - 

4.94 • 

10“1 
S.Ol • 

10“1 
1.57 - 


ACl 

8.24 - 

5.21 - 

10“1 

S.Ol 

10“^ 

1.22 • 


AC2 

10“^ 

0.000 

10“^ 
9.96 • 

10“^ 
4.98 • 

10“^ 
1.25 - 


AC2 

10“^ 

0.000 

10“^ 

1,000 

10“^ 
5.00 • 

10“^ 

9.09 • 


ACS 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
1.25 - 


ACS 

0.000 

1.000 

10“1 
5.00 • 

10“^ 

9.09 • 


CSA 

2.62 - 

S.67 • 

10“^ 
S.15 • 

10“^ 
2.75 - 


CSA 

2.51 - 

S.71 - 

10“^ 

S.ll 

10“^ 

2.62 • 


CGA 

10“1 
1.46 - 

10“1 
4.94 • 

10“1 
S.20 • 

10“1 
1.90 - 


CGA 

10“1 
1.24 - 

10“1 
5,09 - 

10“1 

S.16 

10“1 

1.59 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 

[25, 1] 

ABT 

1.76 - 

4.SI • 

S.OS • 

1.86 - 

[50, 1] 

ABT 

1.72 - 

4.5S - 

S.IS 

1.78 • 


ASB 

10“1 
7.87 - 

10“1 
5.69 • 

10“1 
S.24 • 

10“1 
9.75 - 


ASB 

10“1 
8.61 - 

10“1 
5.84 - 

10“1 
S.S5 • 

10“1 

9.59 • 


ADC 

10“^ 
6.70 - 

10“^ 
S.SO • 

10“^ 
5.00 • 

10“^ 
6.57 - 


ADC 

10“^ 
6.70 - 

10“^ 
S.SO - 

10“^ 
5.00 • 

10“^ 

6.64 • 


CBO 

10“1 
S.75 - 

10“1 
9.96 • 

10“1 
5.00 • 

10“1 
4.19 - 


CBO 

10“1 
S.75 - 

10“1 
9,96 - 

10“1 
5.00 • 

10“1 

2.S2 • 


CBl 

10“^ 
S.75 - 

10“^ 
9.96 • 

10“^ 
5.00 • 

10“^ 
4.19 - 


CBl 

10“^ 
S.75 - 

10“^ 
9,96 - 

10“^ 
5.00 • 

10“^ 

2.S2 • 


CB2 

10“^ 
S.75 - 

10“1 
9.96 • 

10“1 
5.00 • 

10“^ 
4.19 - 


CB2 

10“^ 
S.75 - 

10“1 
9.96 - 

10“1 
5.00 • 

10“^ 

2.S2 • 


ACl 

10“^ 
1.87 - 

10“^ 
6.89 • 

10“^ 
S.54 • 

10“^ 
4.45 - 


ACl 

10“^ 
S.75 - 

10“^ 
8.61 - 

10“^ 
4.SS • 

10“^ 

2.06 • 


AC2 

10“^ 
S.75 - 

10“1 
9.96 • 

10“1 
5.00 • 

10“^ 
4.19 - 


AC2 

10“^ 
S.75 - 

10“1 
9,96 - 

10“1 
5.00 • 

10“^ 

2.S2 • 


ACS 

10“^ 
S.75 - 

10“^ 
9.96 • 

10“^ 
5.00 • 

10“^ 
4.19 - 


ACS 

10“^ 
S.75 - 

10“^ 
9,96 - 

10“^ 
5.00 • 

10“^ 

2.S2 • 


CSA 

10“^ 
1.99 - 

10“1 
S.90 • 

10“1 
2.94 • 

10“^ 
2.06 - 


CSA 

10“^ 
1.27 - 

10“1 
4.64 - 

10“1 
2.96 • 

10“^ 

1.S4 • 


CGA 

10“^ 
5.24 - 

10“^ 
6.67 • 

10“^ 
S.60 • 

10“^ 
7.61 - 


CGA 

10“^ 
S.S7 - 

10“^ 
7.27 - 

10“^ 
S.SO • 

10“^ 

4.7S • 



1 

o 

10“^ 

10“^ 

10”^ 



o 

1 

10“^ 

10“^ 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC Cost Alg FNR FPR CE NEC 

[100, 1] 

ABT 

1.39 - 

4.72 • 

3.05 • 

1.42 - 



10“1 

10“1 

10“1 

10“1 


ASB 

8.24 - 

5.36 • 

3.09 • 

8.69 - 



10“^ 

10“1 

10“1 

10“^ 


ADC 

3.37 - 

6.63 • 

5.00 • 

3.40 - 



10“1 

10“1 

10“1 

10“1 


CBO 

3.75 - 

9.96 • 

5.00 • 

1.36 - 



10“^ 

10“1 

10“1 

10“^ 


CBl 

3.75 - 

9.96 • 

5.00 • 

1.36 - 



10“^ 

10“1 

10“1 

10“^ 


CB2 

3.75 - 

9.96 • 

5.00 • 

1.36 - 



10“^ 

10“^ 

10“^ 

10“^ 


ACl 

3.75 - 

9.96 • 

5.00 • 

1.36 - 



10“^ 

10“1 

10“1 

10“^ 


AC2 

3.75 - 

9.96 • 

5.00 • 

1.36 - 



10“^ 

10“^ 

10“^ 

10“^ 


ACS 

3.75 - 

9.96 • 

5.00 • 

1.36 - 



10“^ 

10“1 

10“1 

10“^ 


CSA 

7.12 - 

5.88 • 

3.30 • 

7.63 - 



10“^ 

10“^ 

10“^ 

10“^ 


CGA 

7.49 - 

8.76 • 

4.42 • 

1.61 - 



10“^ 

10“1 

10“1 

10“^ 
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in all the graphs to have a common reference across the representations. 


































Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1, 100] 

ABT 

1.98 - 

1.11 • 

1.55 • 

1.12 - 

[1, 50] 

ABT 

1.59 - 

1.4S - 

1.51 • 

1.4S • 


ASB 

10“1 
1.11 - 

10“1 
1.98 • 

10“1 
1.55 • 

10“1 
1.98 - 


ASB 

10“1 
7.94 - 

10“1 
1.98 - 

10“1 
1.S9 • 

10“1 

1.96 • 


ADC 

10“^ 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 
9.90 - 


ADC 

10“^ 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 

9.80 • 


CBO 

1.000 

0.000 

10“1 
5.00 • 

10“1 
9.90 - 


CBO 

1.000 

0.000 

10“1 
5.00 • 

10“1 

1.96 • 


CBl 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
9.90 - 


CBl 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 

1.96 • 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10“^ 
9.90 - 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10“^ 

1.96 • 


ACl 

1.000 

0.000 

10“1 
5.00 • 

10“^ 
9.90 - 


ACl 

1.000 

0.000 

10“1 
5.00 • 

10“^ 

1.96 • 


AC2 

1.000 

0.000 

10“1 
5.00 • 

10“^ 
9.90 - 


AC2 

1.000 

0.000 

10“1 
5.00 • 

10“^ 

1.96 • 


ACS 

1.000 

0.000 

10“1 
5.00 • 

10“^ 
9.90 - 


ACS 

1.000 

0.000 

10“1 
5.00 • 

10“^ 

1.96 • 


CSA 

1.51 - 

1.75 • 

10“1 
1.6S • 

10“^ 
1.74 - 


CSA 

7.94 - 

2.94 - 

10“1 
1.87 • 

10“^ 

2.89 • 


CGA 

10“1 
S.41 - 

10“1 
7.94 • 

10“1 
2.10 • 

10“1 
8.20 - 


CGA 

10“^ 

2.SO - 

10“1 
9.52 - 

10“1 
1.6S • 

10“1 

9.79 • 



10“1 

o 

1 

10“1 

10“^ 



10“1 

1 

o 

10“1 

10“^ 

[1, 25] 

ABT 

1.19 - 

2.22 • 

1.71 • 

2.18 - 

[1, 10] 

ABT 

9.52 - 

2.06 - 

1.51 • 

1.96 • 


ASB 

10“1 
7.94 - 

10“1 
1.98 • 

10“1 
1.S9 • 

10“1 
1.94 - 


ASB 

10“^ 
8.7S - 

10“1 

2.SO - 

10“1 
1.59 • 

1 

o - 


ADC 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
9.62 - 


ADC 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“^ 

9.09 • 


CBO 

1.000 

0.000 

10“1 
5.00 • 

10“1 
S.85 - 


CBO 

1.000 

0.000 

10“1 
5.00 • 

10”1 

9.09 • 


CBl 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
S.85 - 


CBl 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 

9.09 • 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10“^ 
S.85 - 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10“^ 

9.09 • 


ACl 

4.29 - 

S.17 

10“^ 

2.SO • 

10“^ 
4.70 - 


ACl 

1.59 - 

1.59 - 

10“^ 
1.59 • 

10“^ 

1.59 • 


AC2 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

10“^ 
S.85 - 


AC2 

10“1 

1.000 

10“1 

0.000 

10“1 
5.00 • 

10“1 

9.09 • 


ACS 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
S.85 - 


ACS 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 

9.09 • 


CSA 

2.S8 - 

2.54 • 

10“1 
1.S9 • 

10“^ 
2.45 - 


CSA 

S.17 - 

S.25 - 

10“1 
1.79 • 

10“^ 

2.99 • 


CGA 

10“^ 

2.SO - 

10“^ 
9.52 • 

10“^ 
1.6S • 

10“^ 
1.00 - 


CGA 

10“^ 
1.51 - 

10“^ 
1.11 - 

10“^ 
l.Sl • 

10“^ 

1.15 • 



10“1 

o 

1 

10“1 

10“1 



10“1 

10“1 

10“1 

10“1 

[1, 7] 

ABT 

9.52 - 

2.06 • 

1.51 • 

1.92 - 

[1. 5] 

ABT 

l.OS - 

1.75 - 

1.S9 • 

1.6S • 


ASB 

10“^ 
l.OS - 

10“^ 
1.75 • 

10“^ 
1.S9 • 

10“^ 
1.66 - 


ASB 

10“^ 
7.14 - 

10“^ 
2.22 - 

10“^ 
1.47 • 

10“^ 

1.97 • 


ADC 

10“1 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
8.75 - 


ADC 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 

8.SS • 


CBO 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
1.25 - 


CBO 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 

1.67 • 


CBl 

1.000 

0.000 

10“1 
5.00 • 

10“1 
1.25 - 


CBl 

1.000 

0.000 

10“1 
5.00 • 

10“1 

1.67 • 


CB2 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
1.25 - 


CB2 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 

1.67 • 


ACl 

7.94 - 

1.98 • 

10“1 
1.S9 • 

10“1 
1.84 - 


ACl 

6.S5 - 

2.54 - 

10“1 
1.59 • 

10“1 

2.22 • 


AC2 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 
1.25 - 


AC2 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 

1.67 • 


ACS 

1.000 

0.000 

10“1 
5.00 • 

10“1 
1.25 - 


ACS 

1.000 

0.000 

10“1 
5.00 • 

10“1 

1.67 • 


CSA 

S.97 - 

S.02 • 

10“^ 
1.71 • 

10“^ 
2.69 - 


CSA 

S.17 - 

S.17 - 

10“^ 
1.75 • 

10“^ 

2.70 • 


CGA 

10“^ 
1.90 - 

10“1 
1.27 • 

10“1 
1.59 • 

10“1 
1.S5 - 


CGA 

10“^ 
1.S5 - 

10“1 
1.4S - 

10“1 
1.S9 • 

10“1 

1.42 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1,3] 

ABT 

l.OS - 

1.75 • 

1.S9 • 

1.57 - 

[1,2] 

ABT 

7.14 - 

2.S8 - 

1.55 • 

1.8S • 


ASB 

10“1 
4.76 - 

10“1 
2.S8 • 

10“1 
1.4S • 

10“1 
1.90 - 


ASB 

10“^ 
7.14 - 

10“1 
1.98 - 

10“1 
1.S5 • 

10“1 

1.56 • 


ADC 

10“^ 
2.06 - 

10“1 
8.49 • 

10“1 
5.28 • 

10“1 
6.88 - 


ADC 

10“^ 
8.65 - 

10“1 
5.00 - 

10“1 
6.8S • 

10“1 

6.22 • 


CBO 

10“1 

1.000 

10“1 

0.000 

10“1 
5.00 • 

10“1 
2.50 - 


CBO 

10“1 

1.000 

10“1 

0.000 

10“1 
5.00 • 

10“1 
s.ss • 


CBl 

9.92 - 

0.000 

10“1 
4.96 • 

10“1 
2.48 - 


CBl 

1.000 

0.000 

10“1 
5.00 • 

10“1 
s.ss • 


CB2 

10“1 

1.000 

0.000 

10“1 
5.00 • 

10“1 
2.50 - 


CB2 

1.000 

0.000 

10“1 
5.00 • 

10“1 
s.ss • 


ACl 

4.76 - 

2.54 • 

10“^ 
1.51 • 

10“^ 
2.02 - 


ACl 

S.97 - 

2.S8 - 

10“^ 
1.S9 • 

10“^ 

1.72 • 


AC2 

10“^ 

1.000 

10“1 

0.000 

10“1 
5.00 • 

10“1 
2.50 - 


AC2 

10“^ 

1.000 

10“1 

0.000 

10“1 
5.00 • 

10“1 

S.SS • 


ACS 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
2.50 - 


ACS 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
s.ss • 


CSA 

2.S8 - 

2.78 • 

10“1 
1.51 • 

10“1 
2.14 - 


CSA 

7.14 - 

2.S8 - 

10“1 
1.55 • 

10“1 

1.8S • 


CGA 

10“^ 
1.4S - 

10“^ 
1.59 • 

10“^ 
1.51 • 

10“^ 
1.55 - 


CGA 

10“^ 
1.19 - 

10“^ 
1.90 - 

10“^ 
1.55 • 

10“^ 

1.67 • 



10“1 

10“1 

10“1 

10“1 



10“1 

10“1 

10“1 

10“1 

[2,3] 

ABT 

7.14 - 

2.S8 • 

1.55 • 

1.71 - 

[1, 1] 

ABT 

7.14 - 

2.S8 - 

1.55 • 

1.55 • 


ASB 

10“^ 
6.S5 - 

10“^ 
2.06 • 

10“^ 
1.S5 • 

10“^ 
1.49 - 


ASB 

10“^ 
l.OS - 

10“^ 
2.14 - 

10“^ 
1.59 • 

10”^ 

1.59 • 


ADC 

10“^ 
6.51 - 

10“1 
5.6S • 

10“1 
6.07 • 

10“1 
5.98 - 


ADC 

10“1 
S.17 - 

10“1 
4.S7 - 

10“1 

2.S4 

10“1 

2.S4 • 


CBO 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 
4.00 - 


CBO 

10“^ 
1.59 - 

10“^ 
5.00 - 

10“^ 
2.58 • 

10“^ 

2.58 • 


CBl 

1.000 

0.000 

10“1 
5.00 • 

10“1 
4.00 - 


CBl 

10“^ 
1.27 - 

10“1 
2.54 - 

10“1 
1.90 • 

10“1 

1.90 • 


CB2 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
4.00 - 


CB2 

10“^ 
l.OS - 

10“^ 
2.14 - 

10“^ 
1.59 • 

10“^ 

1.59 • 


ACl 

6.S5 - 

2.SO • 

10“1 
1.47 • 

10“1 
1.6S - 


ACl 

10“1 
5.56 - 

10“1 
1.98 - 

10“1 
1.27 • 

10“1 

1.27 • 


AC2 

10“^ 

1.000 

10“^ 

0.000 

10“^ 
5.00 • 

10“^ 
4.00 - 


AC2 

10“^ 
l.OS - 

10“^ 
2.14 - 

10“^ 
1.59 • 

10“^ 

1.59 • 


ACS 

1.000 

0.000 

10“1 
5.00 • 

10“1 
4.00 - 


ACS 

10“1 
5.56 - 

10“1 
1.98 - 

10“1 
1.27 • 

10“1 

1.27 • 


CSA 

7.14 - 

2.S8 • 

10“^ 
1.55 • 

10“^ 
1.71 - 


CSA 

10“^ 
l.OS - 

10“^ 
2.14 - 

10“^ 
1.59 • 

10“^ 

1.59 • 


CGA 

10“^ 
1.11 - 

10“1 
1.8S • 

10“1 
1.47 • 

10“1 
1.54 - 


CGA 

10“1 
l.OS - 

10“1 
2.14 - 

10“1 
1.59 • 

10“1 

1.59 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 

[3,2] 

ABT 

7.14 - 

2.S8 • 

1.55 • 

1.S8 - 

[2, 1] 

ABT 

7.14 - 

2.S8 - 

1.55 • 

1.27 • 


ASB 

10“^ 
l.OS - 

10“1 
1.8S • 

10“1 
1.4S • 

10“1 
1.S5 - 


ASB 

10“^ 
l.OS - 

10“1 

2.SO - 

10“1 
1.67 • 

10“1 

1.46 • 


ADC 

10“^ 
2.S8 - 

10“^ 
4.29 • 

10“^ 
2.26 • 

10“^ 
1.86 - 


ADC 

10“^ 
1.59 - 

10“^ 
4.S7 - 

10“^ 
2.26 • 

10“^ 

1.56 • 


CBO 

10“^ 
S.97 - 

10“1 

4.IS • 

10“1 
2.26 • 

10“1 
1.89 - 


CBO 

10“^ 
S.97 - 

10“1 

4.IS - 

10“1 
2.26 • 

10“1 

1.64 • 


CBl 

10“^ 

0.000 

10“^ 
9.60 • 

10“^ 
4.80 • 

10“^ 
S.84 - 


CBl 

10“^ 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 

S.SS • 


CB2 

0.000 

10“1 
8.97 • 

1 

o 

10“1 
S.59 - 


CB2 

0.000 

9.92 - 

10“1 
4.96 • 

10“1 

S.Sl • 


ACl 

8.7S - 

10“^ 
1.75 • 

10“^ 
l.Sl • 

10“^ 
1.22 - 


ACl 

6.S5 - 

10“^ 
1.90 - 

10“^ 
1.27 • 

10“^ 

1.06 • 


AC2 

10“^ 

0.000 

10“1 
9.05 • 

1 

o 

10“1 
S.62 - 


AC2 

10“^ 

0.000 

10“1 
9.S7 - 

10“1 
4.68 • 

10“1 

S.12 • 


ACS 

0.000 

10“^ 
9.29 • 

10“^ 
4.64 • 

10“^ 
S.71 - 


ACS 

0.000 

10“^ 
9.21 - 

10“^ 
4.60 • 

10“^ 

S.07 • 


CSA 

7.14 - 

10“1 
1.98 • 

10“1 
1.S5 • 

10“1 
1.22 - 


CSA 

1.27 - 

10“1 
1.8S - 

10“1 
1.55 • 

10“1 

1.46 • 


CGA 

10“^ 
l.OS - 

10“^ 

2.SO • 

10“^ 
1.67 • 

10“^ 
1.54 - 


CGA 

10“^ 
6.S5 - 

10“^ 
2.54 - 

10“^ 
1.59 • 

10“^ 

1.27 • 



10“^ 

10“^ 

10“1 

10“1 



o 

1 

10“1 

10“^ 

10“1 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[3, 1] 

ABT 

8.7S - 

1.75 • 

l.Sl • 

1.09 - 

[5. 1] 

ABT 

8.7S - 

1.75 - 

l.Sl • 

1.02 • 


ASB 

10“^ 
7.94 - 

10“1 
2.S8 • 

10“1 
1.59 • 

10-1 
1.19 - 


ASB 

10-^ 
7.14 - 

10-1 
2,46 - 

10-1 
1.59 • 

10-1 

1.01 • 


ADC 

10“^ 
1.59 - 

10“1 
4.60 • 

10“1 
2.S8 • 

10-1 
1.27 - 


ADC 

10-^ 
1.59 - 

10-1 
4,60 - 

10-1 
2.S8 • 

10-1 

8.99 • 


CBO 

10“^ 
S.97 - 

10“1 

4.IS • 

10“1 
2.26 • 

10-1 
l.SS - 


CBO 

10-^ 
S.97 - 

10-1 

4.IS - 

10-1 
2.26 • 

10-^ 

1.02 • 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10-1 
2.50 - 


CBl 

10-^ 

0.000 

10-1 

1.000 

10-1 
5.00 • 

10-1 

1.67 • 


CB2 

0.000 

1.000 

10“1 
5.00 • 

10-1 
2.50 - 


CB2 

0.000 

1,000 

10-1 
5.00 • 

10-1 

1.67 • 


ACl 

9.52 - 

1.90 • 

10“^ 
1.4S • 

10-1 
1.19 - 


ACl 

8.7S - 

2.14 - 

10-1 
1.51 • 

10-1 

1.08 • 


AC2 

10“^ 

0.000 

10“1 
9.60 • 

10“1 
4.80 • 

10-1 
2.40 - 


AC2 

10-^ 

0.000 

10-1 
9.92 - 

10-1 
4.96 • 

10-1 

1.65 • 


ACS 

0.000 

10“^ 
9.68 • 

10“^ 
4.84 • 

10-1 
2.42 - 


ACS 

0.000 

10-1 

1.000 

10-1 
5.00 • 

10-1 

1.67 • 


CSA 

1.S5 - 

10“1 
1.67 • 

10“1 
1.51 • 

10-1 
1.4S - 


CSA 

1.67 - 

1.S5 - 

10-1 
1.51 • 

10-1 

1.61 • 


CGA 

10“^ 
2.S8 - 

10“^ 
2.62 • 

10“^ 
1.4S • 

10-1 
8.SS - 


CGA 

10-1 
4.76 - 

IQ-l 
2.70 - 

10-1 
1.59 • 

10-1 

8.47 • 



10“^ 

10“1 

10“1 

IQ-^ 



10-^ 

10-1 

10-1 

10-^ 

P, 1] 

ABT 

7.14 - 

2.14 • 

1.4S • 

8.9S - 

[10, 1] 

ABT 

7.14 - 

2.14 - 

1.4S • 

8.44 • 


ASB 

10“^ 
4.76 - 

10“^ 
2.94 • 

10“^ 
1.71 • 

IQ-^ 
7.84 - 


ASB 

10-^ 
8.7S - 

10-1 
2,86 - 

10-1 
1.87 • 

10-^ 

1.05 • 


ADC 

10“^ 
1.59 - 

10“1 
4.60 • 

10“1 
2.S8 • 

IQ-^ 
7.14 - 


ADC 

10-^ 
1.59 - 

10-1 
4,60 - 

10-1 
2.S8 • 

10-1 

5.6S • 


CBO 

10“^ 
S.97 - 

10“^ 

4.IS • 

10“^ 
2.26 • 

IQ-^ 
8.6S - 


CBO 

10-^ 
S.97 - 

10-1 

4.IS - 

10-1 
2.26 • 

10-^ 

7.S6 • 


CBl 

10“^ 

0.000 

10“1 
9.76 • 

10“1 
4.88 • 

IQ-^ 
1.22 - 


CBl 

10-^ 

0.000 

10-1 
9.92 - 

10-1 
4.96 • 

10-^ 

9.02 • 


CB2 

0.000 

10“^ 
9.84 • 

10“^ 
4,92 • 

10-1 
1.2S - 


CB2 

0.000 

10-1 

1.000 

10-1 
5.00 • 

10-^ 

9.09 • 


ACl 

7.94 - 

10“1 
2.54 • 

10“1 
1.67 • 

10-1 
1.01 - 


ACl 

7.14 - 

S.17 - 

10-1 
1.94 • 

10-^ 

9.S8 • 


AC2 

10“^ 

0.000 

10“^ 

9.IS 

10“^ 
4,56 • 

10-1 
1.14 - 


AC2 

10-^ 

0.000 

IQ-l 

1,000 

10-1 
5.00 • 

10-^ 

9.09 • 


ACS 

0.000 

10“1 
9.92 • 

10“1 
4,96 • 

10-1 
1.24 - 


ACS 

0.000 

1.000 

10-1 
5.00 • 

10-^ 

9.09 • 


CSA 

1.75 - 

10“^ 
1.59 • 

10“^ 
1.67 • 

10-1 
1.7S - 


CSA 

1.8S - 

1.51 - 

10-1 
1.67 • 

10-^ 

1.80 • 


CGA 

10“1 
5.56 - 

10“1 
2.86 • 

10“1 
1.71 • 

10-1 
8.4S - 


CGA 

10-1 
4.76 - 

10-1 
s.ss - 

10-1 
1.90 • 

10-1 

7.S6 • 



10“^ 

10“^ 

10“^ 

IQ-^ 



10-^ 

10-1 

10-1 

10-^ 

[25, 1] 

ABT 

5.56 - 

2.62 • 

1.59 • 

6.S5 - 

[50, 1] 

ABT 

8.7S - 

2,22 - 

1.55 • 

8.99 • 


ASB 

10“^ 
7.94 - 

10“1 
2.70 • 

10“1 
1.75 • 

IQ-^ 
8.67 - 


ASB 

10-^ 
S.97 - 

10-1 
2.86 - 

10-1 
1.6S • 

10-^ 

4.45 • 


ADC 

10“^ 
S.97 - 

10“^ 

4.IS • 

10“^ 
2.26 • 

IQ-^ 
5.40 - 


ADC 

10-^ 
S.97 - 

10-1 

4,IS - 

10-1 
2.26 • 

10-^ 

4.70 • 


CBO 

10“^ 
S.97 - 

10“1 

4.IS • 

10“1 
2.26 • 

IQ-^ 
5.40 - 


CBO 

10-^ 
S.97 - 

10-1 

4.IS - 

10-1 
2.26 • 

10-^ 

4.70 • 


CBl 

10“^ 

0.000 

10“^ 
9.84 • 

1 

o 

IQ-^ 
S.79 - 


CBl 

10-^ 

0.000 

IQ-l 

1,000 

10-1 
5.00 • 

10-^ 

1.96 • 


CB2 

0.000 

10“1 
9.60 • 

10“^ 
4,80 • 

IQ-^ 
S.69 - 


CB2 

0.000 

9.60 - 

10-1 
4.80 • 

10-^ 

1.88 • 


ACl 

S.97 - 

10“^ 

4.IS • 

10“^ 
2.26 • 

IQ-^ 
5.40 - 


ACl 

S.97 - 

IQ-l 

4.IS - 

10-1 
2.26 • 

10-^ 

4.70 • 


AC2 

10“^ 

0.000 

10“1 
9.84 • 

1 

o 

IQ-^ 
S.79 - 


AC2 

10-^ 

0.000 

10-1 
9.68 - 

10-1 
4.84 • 

10-^ 

1.90 • 


ACS 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

IQ-^ 
S.85 - 


ACS 

0.000 

10-1 

1.000 

10-1 
5.00 • 

10-^ 

1.96 • 


CSA 

1.67 - 

1.4S • 

10-1 
1,55 • 

IQ-^ 
1.66 - 


CSA 

2.46 - 

1,75 - 

10-1 

2.10 

10-^ 

2.45 • 


CGA 

10“^ 
2.S8 - 

10“^ 
S.57 • 

10“1 
1.90 • 

10-1 
S.66 - 


CGA 

10-1 
2.S8 - 

10-1 
S.SS - 

10-1 
1.79 • 

10-1 

2.99 • 



10“^ 

10“^ 

10-1 

10”^ 



10“^ 

10-1 

10-1 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost Alg 

FNR FPR CE NEC 

[100, 1] 

ABT 

7.14 - 

2.70 • 

1.71 • 

7.34 - 




ASB 

10“^ 
3.97 - 

10“1 
2.78 • 

10“1 
1.59 • 

10“^ 
4.20 - 




ADC 

10“^ 
3.97 - 

10“1 
4.13 • 

10“1 
2.26 • 

10“^ 
4.34 - 




CBO 

10“^ 
3.97 - 

10“1 
4.13 • 

10“1 
2.26 • 

10“^ 
4.34 - 




CBl 

10“^ 

0.000 

10“1 
9.60 • 

10“1 
4.80 • 

10“^ 
9.51 - 




CB2 

0.000 

10“1 
9.60 • 

10“1 
4.80 • 

10“^ 
9.51 - 




ACl 

3.97 - 

10“^ 
4.13 • 

10“^ 
2.26 • 

10“^ 
4.34 - 




AC2 

10“^ 

0.000 

10“1 
9.21 • 

10“1 
4.60 • 

10“^ 
9.12 - 




ACS 

0.000 

10“^ 
9.21 • 

10“^ 
4.60 • 

10“^ 
9.12 - 




CSA 

2.14 - 

10“1 
2.86 • 

10“1 
2.50 • 

10“^ 
2.15 - 




CGA 

10“^ 
2.38 - 

10“^ 
3.73 • 

10“^ 
1.98 • 

10“^ 
2.73 - 





1 

o 

10“1 

10“1 

10“^ 




Table A-6: Results obtained for the UCI Ionosphere Dataset. 


57 










a 

'o 

u 

"V 

o 




fcn 


X! 

c: 

o 

a 


t2 


a 

X 


3 . 


o 

o 

ffl 

a 

'V 

< 


fl 

<D 

o 

o 

O 

d 

o 

bb 

'S 

0) 

Ih 

cC 

O 


'V 

rt 

o 

a 


Td 

fl 

o 

a 







ABT 

ASB 

CSA 

CGA 


O o >- C-J < 
1 o u u c 


AC1 

AC2 

ACS 

CGA 

t?fT 


t[)l|l^|c 




Q 


XI 

rt 




a 


X 

cu 

.B 

rO 

O 


X 

< 


bO 


rt 

.2 

u 

'm 

03 

s 

O 


o3 

CC^ 


'S 

03 


a 

o 


58 


in all the graphs to have a common reference across the representations. 





































Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1, 100] 

ABT 

1.87 - 

2.26 • 

1.05 • 

2.42 - 

[1, 50] 

ABT 

1.01 - 

4.47 - 

7.28 • 

4.58 • 


ASB 

10“1 
8.61 - 

10“^ 
4.5S • 

10-1 
6.57 • 

IQ-^ 
4.57 - 


ASB 

10-1 
8.28 - 

10-^ 
4,97 - 

10-^ 
6.62 • 

10-^ 

5.OS • 


ADC 

10“^ 
7.15 - 

10“^ 
1.10 • 

10-^ 
S.58 • 

IQ-^ 
8.17 - 


ADC 

10-^ 
7.15 - 

10-^ 
1,10 - 

10-^ 
S.58 • 

10-^ 

1.51 • 


CBO 

10“1 
7.15 - 

10“^ 
1.10 • 

10-1 
S.58 • 

IQ-^ 
8.17 - 


CBO 

10-1 
7.15 - 

10-^ 
1,10 - 

10-1 
S.58 • 

10-^ 

1.51 • 


CBl 

10“^ 
9.75 - 

10“^ 

0.000 

10-1 
4,87 • 

IQ-^ 
9.65 - 


CBl 

10-1 
9.96 - 

10-^ 

0.000 

10-1 
4.98 • 

10-^ 

1.95 • 


CB2 

10“1 
9.47 - 

0.000 

10-1 
4.74 • 

IQ-^ 
9.S8 - 


CB2 

10-1 
9.47 - 

0.000 

10-1 
4.74 • 

10-^ 

1.86 • 


ACl 

10“1 
6.21 - 

1.10 • 

10-1 
S.ll • 

IQ-^ 
7.24 - 


ACl 

10-1 
4.SS - 

4,42 - 

10-1 
2.19 • 

10-^ 

1.28 • 


AC2 

10“1 
8.98 - 

10“^ 

0.000 

10-1 
4.49 • 

IQ-^ 
8.90 - 


AC2 

10-1 
9.94 - 

10-^ 

0.000 

10-1 
4.97 • 

10-^ 

1.95 • 


ACS 

10“1 
9.S9 - 

0.000 

10-1 
4.70 • 

IQ-^ 

9.SO - 


ACS 

10-1 
9.66 - 

0.000 

10-1 
4.8S • 

10-^ 

1.89 • 


CSA 

10“1 
1.56 - 

4.42 • 

10-1 
1.00 • 

IQ-^ 
4.5S - 


CSA 

10-1 
8.66 - 

7,S4 - 

10-1 
8.00 • 

10-^ 

7.S7 • 


CGA 

10“1 
2.94 - 

10“^ 
1.S2 • 

10-1 
1.5S • 

IQ-^ 
1.60 - 


CGA 

10-^ 
1.77 - 

10-^ 
2.59 - 

10-^ 
1.02 • 

10-^ 

2.89 • 



10“1 

10“^ 

10-1 

IQ-^ 



10-1 

10-^ 

10-1 

10-^ 

[1, 25] 

ABT 

8.SS - 

5.SO • 

6.82 • 

5.41 - 

[1, 10] 

ABT 

6.7S - 

6.68 - 

6.71 • 

6.68 • 


ASB 

10“^ 
7.84 - 

10“^ 
5.68 • 

10-^ 
6.76 • 

IQ-^ 
5.77 - 


ASB 

10-^ 
7.51 - 

10-^ 
5.6S - 

10-^ 
6.57 • 

10-^ 

5.80 • 


ADC 

10“^ 
7.15 - 

10“^ 
1.10 • 

10-^ 
S.58 • 

IQ-^ 
2.85 - 


ADC 

10-^ 

6.SI - 

10-^ 
1.4S - 

10-^ 
S.2S • 

10-^ 

7.04 • 


CBO 

10“1 
8.2S - 

10“^ 
5.52 • 

10-1 
4.12 • 

IQ-^ 
S.22 - 


CBO 

10-1 
8.18 - 

10-^ 
5,52 - 

10-1 
4.09 • 

10-^ 

7.49 • 


CBl 

10“^ 
9.87 - 

10-4 

0.000 

10-1 
4,9S • 

IQ-^ 
S.80 - 


CBl 

10-1 
9.95 - 

10-4 

0.000 

10-1 
4.98 • 

10-^ 

9.05 • 


CB2 

10“1 

1.000 

0.000 

10-1 
5,00 • 

IQ-^ 
S.85 - 


CB2 

10-1 
9.98 - 

0.000 

10-1 
4.99 • 

10-^ 

9.07 • 


ACl 

2.S5 - 

2.15 • 

10-1 
1.28 • 

IQ-^ 
2.97 - 


ACl 

10-1 
1.11 - 

4.19 - 

10-1 
7.67 • 

10-^ 

4.8S • 


AC2 

10“1 
9.91 - 

10“^ 

0.000 

1 

o 

IQ-^ 
S.81 - 


AC2 

10-1 
9.98 - 

10-^ 

0.000 

10-^ 
4.99 • 

10-^ 

9.07 • 


ACS 

10“^ 
9.74 - 

0.000 

io“i 

4.87 • 

IQ-^ 
S.74 - 


ACS 

10-1 
9.87 - 

0.000 

10-1 
4.9S • 

10-^ 

8.97 • 


CSA 

10“1 
6.40 - 

7.95 • 

10-1 
7.17 • 

IQ-^ 
7.89 - 


CSA 

10-1 
5.08 - 

9.S8 - 

10-1 
7.2S • 

10-^ 

8.99 • 


CGA 

10“^ 
1.24 - 

10“^ 
4.08 • 

10-^ 
8.25 • 

IQ-^ 
4.40 - 


CGA 

10-^ 
9.11 - 

10-^ 
4.86 - 

10-^ 
6.98 • 

10-^ 

5.24 • 



10“1 

10“^ 

10-^ 

IQ-^ 



10-^ 

10-^ 

10-^ 

10-^ 

[1, 7] 

ABT 

6.46 - 

7.2S • 

6.84 • 

7.IS - 

[1. 5] 

ABT 

6.51 - 

7,2S - 

6.87 • 

7.11 • 


ASB 

10“^ 
7.28 - 

10“^ 
5.91 • 

10-^ 
6.59 • 

IQ-^ 
6.08 - 


ASB 

10-^ 
7.06 - 

10-^ 
6.24 - 

10-^ 
6.65 • 

10-^ 

6.S7 • 


ADC 

10“^ 

6.SI - 

10“^ 
1.4S • 

10-^ 
S.2S • 

IQ-^ 
9.14 - 


ADC 

10-^ 
5.70 - 

10-^ 
1.82 - 

10-^ 
2.94 • 

10-^ 

1.10 • 


CBO 

10“^ 

8.IS - 

10“^ 
S.Sl • 

10-1 
4.08 • 

IQ-^ 
1.05 - 


CBO 

10-1 

8.IS - 

10-^ 
S.Sl - 

10-1 
4.08 • 

10-1 

1.S8 • 


CBl 

10“1 
9.98 - 

10“^ 

0.000 

1 

o 

10-1 
1.25 - 


CBl 

10-1 
9.9S - 

10-^ 

0.000 

10-1 
4.97 • 

10-1 

1.66 • 


CB2 

10“^ 
9.99 - 

0.000 

io“i 

5.00 • 

10-1 
1.25 - 


CB2 

10-1 
9.98 - 

0,000 

10-1 
4.99 • 

10-1 

1.66 • 


ACl 

10“1 
9.71 - 

5.SO • 

10-1 
7,51 • 

10-1 
5.85 - 


ACl 

10-1 
7.40 - 

6.02 - 

10-1 
6.71 • 

10-1 

6.25 • 


AC2 

10“^ 
9.94 - 

10“^ 

0.000 

10-^ 
4.97 • 

10-^ 
1.24 - 


AC2 

10-^ 
9.84 - 

10-^ 

0.000 

10-^ 
4.92 • 

10-^ 

1.64 • 


ACS 

10“1 
9.92 - 

0.000 

10-1 
4,96 • 

10-1 
1.24 - 


ACS 

10-1 
9.97 - 

0,000 

10-1 
4.99 • 

10-1 

1.66 • 


CSA 

10“^ 
5.02 - 

9.55 • 

10-1 
7.28 • 

10-1 
8.98 - 


CSA 

10-1 
4.75 - 

9.82 - 

10-1 
7.28 • 

10-1 

8.98 • 


CGA 

10“^ 
8.17 - 

10“^ 

5.19 

10-^ 
6,68 • 

10-^ 
5.56 - 


CGA 

10-^ 
7.7S - 

10-^ 
5.79 - 

10-^ 
6.76 • 

10-^ 

6.12 • 



10“^ 

10“^ 

10-^ 

10-^ 



10-^ 

10-^ 

10-^ 

10-^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1,3] 

ABT 

6.24 - 

7.45 • 

6.84 • 

7.15 - 

[1,2] 

ABT 

5.96 - 

7.89 - 

6.9S • 

7.25 • 


ASB 

10“^ 
6.7S - 

10“^ 
6.51 • 

10“^ 
6.62 • 

10“^ 
6.57 - 


ASB 

10“^ 
6.46 - 

10“^ 
6.95 - 

10-^ 

6.71 • 

10-^ 

6.79 • 


ADC 

10“^ 
5.60 - 

10“^ 
1.71 • 

10“^ 
2.88 • 

10“^ 
1.5S - 


ADC 

10“^ 

5.OS - 

10“^ 
S.15 - 

10-^ 
2.67 • 

10-^ 

1.89 • 


CBO 

10“1 

8.IS - 

10“^ 
S.Sl • 

10“1 
4.08 • 

10“1 
2.06 - 


CBO 

10“1 
8.14 - 

10“^ 
S.Sl - 

10-4 
4.09 • 

10-4 

2.74 • 


CBl 

10“^ 
9.99 - 

10“^ 

0.000 

10“1 
5.00 • 

10“1 
2.50 - 


CBl 

10“1 

1.000 

10“^ 

0.000 

10-4 
5.00 • 

10-4 
s.ss • 


CB2 

10“1 

1.000 

0.000 

10“1 
5.00 • 

10“1 
2.50 - 


CB2 

9.98 - 

0.000 

10-4 
4.99 • 

10-4 

S.SS • 


ACl 

5.68 - 

6.18 • 

10“^ 
5.9S • 

10“^ 
6.06 - 


ACl 

10“^ 
5.02 - 

6.46 - 

10-4 
5.74 • 

10-4 

5.98 • 


AC2 

10“^ 
9.99 - 

10“^ 

0.000 

10“^ 
4.99 • 

10“^ 
2.50 - 


AC2 

10“^ 
9.98 - 

10“^ 

0.000 

10-^ 
4.99 • 

10-^ 

S.SS • 


ACS 

10“^ 
9.97 - 

0.000 

1 

o 

10“^ 
2.49 - 


ACS 

10“^ 
9.98 - 

0.000 

10-4 
4.99 • 

10-4 

S.SS • 


CSA 

10“1 
4.75 - 

9.44 • 

10“^ 
7.09 • 

10“1 
8.26 - 


CSA 

10“1 
4.75 - 

8.89 - 

10-4 
6.82 • 

10-4 

7.51 • 


CGA 

10“^ 
7.06 - 

10“^ 
6.24 • 

10“^ 
6.65 • 

10“^ 
6.44 - 


CGA 

10“^ 
6.S5 - 

10“^ 
6.7S - 

10-^ 
6.54 • 

10-^ 

6.60 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10-^ 

10-^ 

[2,3] 

ABT 

6.02 - 

7.89 • 

6.95 • 

7.14 - 

[1, 1] 

ABT 

5.96 - 

7.84 - 

6.90 • 

6.90 • 


ASB 

10“^ 

6.IS - 

10“^ 
7.2S • 

10“^ 
6.68 • 

10“^ 
6.79 - 


ASB 

10“^ 
5.85 - 

10“^ 
7.89 - 

10-^ 
6.87 • 

10-^ 

6.87 • 


ADC 

10“^ 
2.29 - 

10“^ 
1.67 • 

10“^ 
1.98 • 

10“^ 
1.92 - 


ADC 

10“^ 
1.91 - 

10“^ 
2.18 - 

10-^ 
2.04 • 

10-^ 

2.04 • 


CBO 

10“^ 
8.14 - 

10“^ 
2.76 • 

10“^ 
4.08 • 

10“^ 
S.27 - 


CBO 

10“^ 
1.91 - 

10“4 
2.18 - 

10-4 
2.04 • 

10-4 

2.04 • 


CBl 

10“1 

1.000 

10“^ 

0.000 

10“1 
5.00 • 

10“1 
4.00 - 


CBl 

10“1 
2.72 - 

10-4 

4.06 - 

10-4 
S.S9 • 

10-4 

S.S9 • 


CB2 

9.99 - 

0.000 

10“^ 
4.99 • 

10“^ 
4.00 - 


CB2 

10“^ 
5.85 - 

10-4 
7.89 - 

10-4 
6.87 • 

10-4 

6.87 • 


ACl 

10“1 
4.97 - 

6.29 • 

10“1 
5.6S • 

10“1 
5.76 - 


ACl 

10“^ 
5.24 - 

IQ-^ 
6.79 - 

10-^ 
6.02 • 

10-^ 

6.02 • 


AC2 

10“^ 
9.98 - 

10“^ 

0.000 

10“^ 
4.99 • 

10“^ 
S.99 - 


AC2 

10“^ 
5.85 - 

IQ-^ 
7.89 - 

10-^ 
6.87 • 

10-^ 

6.87 • 


ACS 

10“1 
9.97 - 

0.000 

1 

o 

10“1 
S.99 - 


ACS 

10“^ 
5.24 - 

IQ-^ 
6.79 - 

10-^ 
6.02 • 

10-^ 

6.02 • 


CSA 

10“^ 

5.SO - 

8.S9 • 

10“^ 
6.84 • 

10“^ 
7.15 - 


CSA 

10“^ 
5.85 - 

IQ-^ 
7.89 - 

10-^ 
6.87 • 

10-^ 

6.87 • 


CGA 

10“^ 
6.24 - 

10“^ 
7.45 • 

10“^ 
6.84 • 

10“^ 
6.96 - 


CGA 

10“^ 
5.85 - 

IQ-^ 
7.89 - 

10-^ 
6.87 • 

10-^ 

6.87 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

IQ-^ 

10-^ 

10-^ 

[3,2] 

ABT 

5.85 - 

7.89 • 

6.87 • 

6.67 - 

[2, 1] 

ABT 

5.46 - 

8.00 - 

6.7S • 

6.SI • 


ASB 

10“^ 
5.6S - 

10“^ 
7.95 • 

10“^ 
6.79 • 

10“^ 
6.56 - 


ASB 

10“^ 
5.S5 - 

IQ-^ 
8.SS - 

10-^ 
6.84 • 

10-^ 

6.S5 • 


ADC 

10“^ 
1.56 - 

10“^ 

2.SI • 

10“^ 
1.9S • 

10“^ 
1.86 - 


ADC 

10“^ 
2.S2 - 

IQ-^ 
4.06 - 

IQ-^ 

2.14 

10-^ 

1.51 • 


CBO 

10“1 
6.07 - 

10“1 
9.29 • 

10“1 
4.67 • 

10“1 
S.75 - 


CBO 

10“^ 
6.07 - 

10-4 
9.28 - 

10-4 
4.67 • 

10-4 

S.IS • 


CBl 

10“^ 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 
4.00 - 


CBl 

10“^ 

0.000 

10-4 
9.99 - 

10-4 
4.99 • 

10-4 

S.SS • 


CB2 

0.000 

9.97 • 

1 

o 

10“1 
S.99 - 


CB2 

0.000 

10-4 
9.99 - 

10-4 
4.99 • 

10-4 

S.SS • 


ACl 

5.19 - 

10“^ 
6.90 • 

10“^ 
6.04 • 

10“^ 
5.87 - 


ACl 

5.02 - 

10-4 
7.01 - 

10-4 
6.02 • 

10-4 

5.68 • 


AC2 

10“^ 

0.000 

10“^ 
9.99 • 

10“^ 
4.99 • 

10“^ 
4.00 - 


AC2 

10“^ 
5.52 - 

IQ-^ 
9.97 - 

10-^ 
4.99 • 

10-^ 

S.SS • 


ACS 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 
4.00 - 


ACS 

10-4 

0.000 

10-4 

1.000 

10-4 
5.00 • 

10-4 

S.SS • 


CSA 

6.24 - 

7.12 • 

10“1 
6.68 • 

10“1 
6.59 - 


CSA 

6.46 - 

6.29 - 

10-4 
6.S7 • 

10-4 

6.40 • 


CGA 

10“^ 
5.S5 - 

10“^ 
8.11 • 

10“^ 
6.7S • 

10“^ 
6.46 - 


CGA 

10“^ 
5.24 - 

IQ-^ 
8.28 - 

10-^ 
6.76 • 

10-^ 

6.25 • 



10“^ 

10“^ 

10“^ 

10”^ 



10“^ 

10“^ 

10”^ 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[3, 1] 

ABT 

5.46 - 

8.06 • 

6.76 • 

6.11 - 

[5. 1] 

ABT 

5.24 - 

8.06 - 

6.65 • 

5.71 • 


ASB 

10“^ 
5.08 - 

10“^ 
8.SS • 

10“^ 
6.71 • 

10“^ 
5.89 - 


ASB 

10“^ 
4.97 - 

10“^ 
8.55 - 

10“^ 
6.76 • 

10“^ 

5.56 • 


ADC 

10“^ 
1.S2 - 

10“^ 
4.56 • 

10“^ 
2.S5 • 

10“^ 
1.24 - 


ADC 

10“^ 
1.27 - 

10“^ 
5.64 - 

10“^ 
2.88 • 

10“^ 

1.05 • 


CBO 

10“^ 
6.07 - 

10“1 
9.29 • 

10“1 
4.67 • 

10“1 
2.S7 - 


CBO 

10“^ 
6.07 - 

10“1 
9.29 - 

10“1 
4.68 • 

10“1 

1.60 • 


CBl 

10“^ 

0.000 

10“1 
9.99 • 

10“1 
5.00 • 

10“1 
2.50 - 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 

1.67 • 


CB2 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
2.50 - 


CB2 

0.000 

9.97 - 

10“1 
4.98 • 

10“1 

1.66 • 


ACl 

4.97 - 

7.17 • 

10“^ 
6.07 • 

10“^ 
5.52 - 


ACl 

4.80 - 

10“^ 
8.66 - 

10“^ 
6.7S • 

10“^ 

5.45 • 


AC2 

10“^ 

0.000 

10“^ 
9.9S • 

10“^ 
4.96 • 

10“^ 
2.48 - 


AC2 

10“^ 

0.000 

10“^ 
9.90 - 

10“^ 
4.95 • 

10“^ 

1.65 • 


ACS 

0.000 

10“^ 
9.99 • 

10“^ 
4.99 • 

10“^ 
2.50 - 


ACS 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 

1.67 • 


CSA 

7.2S - 

10“1 
5.57 • 

10“1 
6.40 • 

10“1 
6.82 - 


CSA 

7.56 - 

5.68 - 

10“1 
6.62 • 

10“1 

7.25 • 


CGA 

10“^ 
4.97 - 

10“^ 
8.50 • 

10“^ 
6.7S • 

10“^ 
5.85 - 


CGA 

10“^ 
4.25 - 

10“^ 
9.55 - 

10“^ 
6.90 • 

10“^ 

5.IS • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 

P, 1] 

ABT 

5.IS - 

8.11 • 

6.62 • 

5.50 - 

[10, 1] 

ABT 

4.80 - 

8.28 - 

6.54 • 

5.12 • 


ASB 

10“^ 
4.5S - 

10“^ 
8.61 • 

10“^ 
6.57 • 

10“^ 
5.04 - 


ASB 

10“^ 
4.42 - 

10“^ 
8.61 - 

10“^ 

6.51 

10“^ 

4.80 • 


ADC 

10“^ 
1.27 - 

10“^ 
5.86 • 

10“^ 
2.99 • 

10“^ 
8.4S - 


ADC 

10“^ 
1.05 - 

10“^ 
6.S6 - 

10“^ 

S.2S 

10“^ 

6.7S • 


CBO 

10“^ 
6.07 - 

10“^ 
9.29 • 

10“^ 
4.68 • 

10“^ 
1.21 - 


CBO 

10“^ 
6.07 - 

10“^ 
9.S6 - 

10“^ 
4.71 • 

10“^ 

9.06 • 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
1.25 - 


CBl 

10“^ 

0.000 

10“1 
9.94 - 

10“1 
4.97 • 

10“^ 

9.04 • 


CB2 

5.52 - 

9.9S • 

10“^ 
4.97 • 

10“^ 
1.25 - 


CB2 

0.000 

10“^ 
9.9S - 

10“^ 
4.97 • 

10“^ 

9.OS • 


ACl 

10“'^ 
4.5S - 

10“1 
9.66 • 

10“1 
7.09 • 

10“1 
5.17 - 


ACl 

S.64 - 

10“1 
1.14 - 

10“1 
7.51 • 

10“^ 

4.S4 • 


AC2 

10“^ 

0.000 

10“^ 
9.98 • 

10“^ 
4.99 • 

10“^ 
1.25 - 


AC2 

10“^ 

0.000 

10“^ 
9.98 - 

10“^ 
4.99 • 

10“^ 

9.08 • 


ACS 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
1.25 - 


ACS 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“^ 

9.09 • 


CSA 

7.2S - 

5.52 • 

10“^ 
6.S7 • 

10“^ 
7.02 - 


CSA 

7.45 - 

6.24 - 

10“^ 
6.84 • 

10“^ 

7.S4 • 


CGA 

10“^ 
S.97 - 

10“^ 
9.66 • 

10“^ 
6.82 • 

10“^ 
4.68 - 


CGA 

10“^ 
S.59 - 

10“^ 
l.OS - 

10“^ 
6.9S • 

10“^ 

4.19 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 

[25, 1] 

ABT 

4.OS - 

9.S8 • 

6.71 • 

4.2S - 

[50, 1] 

ABT 

2.98 - 

1.20 - 

7.51 • 

S.16 • 


ASB 

10“^ 

4.OS - 

10“^ 
8.8S • 

10“^ 
6.4S • 

10“^ 
4.21 - 


ASB 

10“^ 
S.86 - 

10“1 
9.SS - 

10“^ 
6.59 • 

10“^ 

S.97 • 


ADC 

10“^ 
1.4S - 

10“^ 
6.95 • 

10“^ 
S.55 • 

10“^ 
4.05 - 


ADC 

10“^ 
8.28 - 

10“^ 
8.82 - 

10“^ 
4.45 • 

10“^ 

2.54 • 


CBO 

10“^ 
4.42 - 

10“1 
9.45 • 

10“1 
4.75 • 

10“^ 
4.06 - 


CBO 

10“^ 
8.28 - 

10“1 
8.82 - 

10“1 
4.45 • 

10“^ 

2.54 • 


CBl 

10“^ 

0.000 

10“^ 
9.70 • 

10“^ 
4.85 • 

10“^ 
S.7S - 


CBl 

10“^ 

0.000 

10“^ 
9.59 - 

10“^ 
4.79 • 

10“^ 

1.88 • 


CB2 

5.52 - 

10“1 
9.81 • 

10“1 
4.91 • 

10“^ 
S.8S - 


CB2 

0.000 

10“1 
9.79 - 

10“1 
4.90 • 

10“^ 

1.92 • 


ACl 

10-^ 
1.55 - 

10“^ 
2.4S • 

10“^ 
1.29 • 

10“^ 
2.42 - 


ACl 

1.10 - 

10“^ 
S.Sl - 

10“^ 
1.71 • 

10“^ 

1.7S • 


AC2 

10“^ 

0.000 

10“1 
9.8S • 

1 

o 

10“^ 
S.78 - 


AC2 

10“^ 

0.000 

10“1 
9.9S - 

10“1 
4.97 • 

10“^ 

1.95 • 


ACS 

0.000 

10“^ 
9.99 • 

1 

o 

10“^ 
S.84 - 


ACS 

0.000 

10“^ 
9.99 - 

10“^ 
5.00 • 

10“^ 

1.96 • 


CSA 

6.62 - 

10“1 

7.17 • 

10“^ 
6.90 • 

10“^ 
6.64 - 


CSA 

5.52 - 

10“1 
9.55 - 

10“1 
7.5S • 

10“^ 

5.60 • 


CGA 

10“^ 
S.04 - 

10“^ 
l.Sl • 

10“^ 
8.06 • 

10“^ 
S.42 - 


CGA 

10“^ 
2.10 - 

10“^ 
1.68 - 

10“^ 
9.46 • 

10“^ 

2.S9 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10”^ 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC Cost Alg 

FNR FPR CE NEC 

[100, 1] 

ABT 

2.10 - 

1.55 • 

8.80 • 

2.23 - 




10“^ 

10“1 

10“^ 

10“^ 



ASB 

3.75 - 

9.49 • 

6.62 • 

3.81 - 




10“^ 

10“^ 

10“^ 

10“^ 



ADC 

6.62 - 

9.28 • 

4.67 • 

1.57 - 




10“^ 

10“1 

10“1 

10“^ 



CBO 

6.62 - 

9.28 • 

4.67 • 

1.57 - 




10“^ 

10“1 

10“1 

10“^ 



CBl 

6.62 - 

9.28 • 

4.67 • 

1.57 - 




10“^ 

10“1 

10“1 

10“^ 



CB2 

6.62 - 

9.28 • 

4.67 • 

1.57 - 




10“^ 

10“^ 

10“^ 

10“^ 



ACl 

7.17 - 

4.95 • 

2.51 • 

1.20 - 




10“^ 

10“1 

10“1 

10“^ 



AC2 

6.62 - 

9.28 • 

4.67 • 

1.57 - 




10“^ 

10“^ 

10“^ 

10“^ 



ACS 

6.62 • 

9.28 • 

4.67 • 

1.57 - 




10“^ 

10“1 

10“1 

10“^ 



CSA 

3.48 - 

1.52 • 

9.33 • 

3.59 - 




10“^ 

10“^ 

10“^ 

10“^ 



CGA 

1.60 - 

2.36 • 

1.26 • 

1.82 - 




10“^ 

10“1 

10“1 

10“^ 
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in all the graphs to have a common reference across the representations. 
















































Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1, 100] 

ABT 

2.05 - 

S.IO • 

1.18 • 

S.28 - 

[1, 50] 

ABT 

1.75 - 

4.50 - 

1.10 • 

4.76 • 


ASB 

10“1 
1.00 - 

10“^ 
6.51 • 

10“1 
8.26 • 

10“^ 
6.54 - 


ASB 

10“1 
1.00 - 

10“^ 
6.51 - 

10“1 
8.26 • 

10“^ 

6.58 • 


ADC 

10“^ 
8.S6 - 

10“^ 
6.01 • 

10“^ 
4.21 • 

10“^ 
1.42 - 


ADC 

10“^ 
8.36 - 

10“^ 
6.01 - 

10“^ 
4.21 • 

10“^ 

2.23 • 


CBO 

10“1 
8.S6 - 

10“^ 
6.01 • 

10“1 
4.21 • 

10“^ 
1.42 - 


CBO 

10“1 
8.36 - 

10“^ 
6.01 - 

10“1 
4.21 • 

10“^ 

2.23 • 


CBl 

10“^ 
9.64 - 

10“^ 

0.000 

10“^ 
4.82 • 

10“^ 
9.54 - 


CBl 

10“^ 
9.87 - 

10“^ 

0.000 

10“^ 
4.93 • 

10“^ 

1.94 • 


CB2 

10“1 
9.48 - 

0.000 

10“1 
4.74 • 

10“^ 
9.S9 - 


CB2 

10“1 
9.87 - 

0.000 

10“1 
4.93 • 

10“^ 

1.94 • 


ACl 

10“1 
S.21 - 

S.OO • 

10“1 
1.62 • 

10“^ 
6.15 - 


ACl 

10“1 
1.61 - 

1.10 - 

10“1 
8.61 • 

10“^ 

1.40 • 


AC2 

10“1 

9.SO - 

10“^ 

0.000 

10“1 
4.65 • 

10“^ 
9.21 - 


AC2 

10“1 
9.71 - 

10“^ 

0.000 

10“^ 
4.85 • 

10“^ 

1.90 • 


ACS 

10“1 
9.SS - 

0.000 

10“1 
4.66 • 

10“^ 
9.24 - 


ACS 

10“1 
9.77 - 

0.000 

10“1 
4.88 • 

10“^ 

1.92 • 


CSA 

10“1 
4.00 - 

2.47 • 

10“1 
1.44 • 

10“^ 
2.45 - 


CSA 

10“1 
1.43 - 

7.41 - 

10“1 
1.09 • 

10“^ 

7.54 • 


CGA 

10“^ 
2.S6 - 

10“1 
1.50 • 

10“1 
1.26 • 

10“1 
1.72 - 


CGA 

10“1 
2.06 - 

10“^ 
1.40 - 

10“1 
1.10 • 

10“^ 

1.78 • 



10“1 

10“^ 

10“1 

10“^ 



10“1 

10“^ 

10“1 

10“^ 

[1, 25] 

ABT 

1.41 - 

6.51 • 

l.OS • 

6.80 - 

[1, 10] 

ABT 

1.06 - 

6.71 - 

8.66 • 

7.06 • 


ASB 

10“1 
9.41 - 

10“^ 
5.71 • 

10“1 
7.56 • 

10“^ 
5.85 - 


ASB 

10“1 
9.41 - 

10“^ 
5.71 - 

10“^ 
7.56 • 

10“^ 

6.04 • 


ADC 

10“^ 
8.2S - 

10“^ 
1.00 • 

10“^ 
4.12 • 

10“^ 
S.26 - 


ADC 

10“^ 
7.14 - 

10“^ 
3.00 - 

10“^ 
3.58 • 

10“^ 

6.76 • 


CBO 

10“1 
8.S6 - 

10“^ 
6.01 • 

10“1 
4.21 • 

10“^ 
S.79 - 


CBO 

10“1 
8.38 - 

10“^ 
6.01 - 

10“1 
4.22 • 

10“^ 

8.16 • 


CBl 

10“^ 
9.94 - 

10“^ 

0.000 

10“^ 
4.97 • 

10“^ 
S.82 - 


CBl 

10“^ 
9.95 - 

10“^ 

0.000 

10“^ 
4.97 • 

10“^ 

9.05 • 


CB2 

10“1 
9.96 - 

0.000 

10“1 
4.98 • 

10“^ 
S.83 - 


CB2 

10“1 

1.000 

0.000 

10“1 
5.00 • 

10“^ 

9.09 • 


ACl 

10“^ 

8.SI - 

8.90 • 

10“^ 
6.11 • 

10“^ 
4.07 - 


ACl 

5.91 - 

8.61 - 

10“^ 
7.26 • 

10“^ 

8.36 • 


AC2 

10“^ 
9.82 - 

10“^ 

0.000 

10“^ 
4.91 • 

10“^ 
3.78 - 


AC2 

10“^ 
9.98 - 

10“^ 

0.000 

10“^ 
4.99 • 

10“^ 

9.07 • 


ACS 

10“^ 
9.76 - 

0.000 

10“^ 
4.88 • 

10“^ 
3.75 - 


ACS 

10“^ 
9.96 - 

0.000 

10“^ 
4.98 • 

10“^ 

9.05 • 


CSA 

10“1 
6.51 - 

1.09 • 

10“1 
8.71 • 

10“^ 
1.07 - 


CSA 

10“1 
6.91 - 

1.01 - 

10“1 
8.51 • 

10“^ 

9.82 • 


CGA 

10“^ 
1.77 - 

10“^ 
2.10 • 

10“^ 
9.91 • 

10“^ 
2.70 - 


CGA 

10“^ 
1.36 - 

10“^ 
2.60 - 

10“^ 

8.11 

10“^ 

3.60 • 



10“1 

10“^ 

10“^ 

10“^ 



10“1 

10“^ 

10“^ 

10“^ 

[1, 7] 

ABT 

1.06 - 

6.71 • 

8.66 • 

7.19 - 

[1. 5] 

ABT 

1.10 - 

6.81 - 

8.91 • 

7.51 • 


ASB 

10“^ 
9.41 - 

10“^ 
5.71 • 

10“^ 
7.56 • 

10“^ 
6.17 - 


ASB 

10“^ 
9.41 - 

10“^ 
5.71 - 

10“^ 
7.56 • 

10“^ 

6.32 • 


ADC 

10“^ 
7.45 - 

10“^ 
1.00 • 

10“^ 
S.7S • 

10“^ 
9.40 - 


ADC 

10“^ 
6.33 - 

10“^ 
1.90 - 

10“^ 
3.26 • 

10“^ 

1.21 • 


CBO 

10“^ 
8.40 - 

10“^ 
6.01 • 

10“^ 
4.2S • 

10“^ 
1.10 - 


CBO 

10“^ 
8.36 - 

10“^ 
5.01 - 

10“^ 
4.20 • 

10“^ 

1.43 • 


CBl 

10“1 
9.98 - 

10“^ 

0.000 

1 

o 

10“1 
1.25 - 


CBl 

10“1 
9.98 - 

10“^ 

0.000 

10“1 
4.99 • 

10“1 

1.66 • 


CB2 

10“^ 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 
1.25 - 


CB2 

10“^ 

1.000 

0.000 

10“^ 
5.00 • 

10“^ 

1.67 • 


ACl 

5.51 - 

9.SI • 

10“1 
7.41 • 

10“1 
8.83 - 


ACl 

6.11 - 

9.31 - 

10“1 
7.71 • 

10“1 

8.78 • 


AC2 

10“^ 
9.96 - 

10“^ 

0.000 

10“^ 
4.98 • 

10“^ 
1.24 - 


AC2 

10“^ 
9.98 - 

10“^ 

0.000 

10“^ 
4.99 • 

10“^ 

1.66 • 


ACS 

10“1 
9.96 - 

0.000 

10“1 
4.98 • 

10“1 
1.24 - 


ACS 

10“1 
9.95 - 

0.000 

10“1 
4.97 • 

10“1 

1.66 • 


CSA 

10“^ 
6.21 - 

I.IS • 

10“^ 
8.76 • 

10“^ 
1.07 - 


CSA 

10“^ 
7.41 - 

1.05 - 

10“^ 
8.96 • 

10“^ 

9.99 • 


CGA 

10“^ 
1.66 - 

10“1 
4.60 • 

10“^ 
1.06 • 

10“1 
6.11 - 


CGA 

10“^ 
1.46 - 

10“1 
4.50 - 

10“^ 
9.56 • 

10“^ 

6.19 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[1,3] 

ABT 

1.08 - 

5.41 • 

8.11 • 

6.76 - 

[1.2] 

ABT 

1.07 - 

5.71 - 

8.21 • 

7.S7 • 


ASB 

10“1 
8.81 - 

10“^ 
6.41 • 

10“^ 
7.61 • 

10“^ 
7.01 - 


ASB 

10“1 
9.01 - 

10“^ 

6.SI - 

10“^ 
7.66 • 

10“^ 

7.21 • 


ADC 

10“^ 
4.55 - 

10“^ 
5.41 • 

10“^ 
2.55 • 

10“^ 
1.54 - 


ADC 

10“^ 
S.S7 - 

10“^ 
7,01 - 

10“^ 
2.04 • 

10“^ 

1.59 • 


CBO 

10“1 
8.S7 - 

10“^ 
2.00 • 

10“1 
4.19 • 

10“1 
2.11 - 


CBO 

10“1 
8.S7 - 

10“^ 
1.00 - 

10“1 
4.19 • 

10“1 

2.80 • 


CBl 

10“1 
9.99 - 

10“^ 

0.000 

10“1 
4.99 • 

10“1 
2.50 - 


CBl 

10“1 
9.95 - 

10“^ 

0.000 

10“1 
4.97 • 

10“1 

S.S2 • 


CB2 

10“1 
9.96 - 

0.000 

10“1 
4.98 • 

10“1 
2.49 - 


CB2 

10“1 
9.9S - 

0,000 

10“1 
4.96 • 

10“1 

S.Sl • 


ACl 

10“^ 
6.41 - 

9.21 • 

10“^ 
7.81 • 

10“^ 
8.51 - 


ACl 

10“^ 
7.11 - 

7,71 - 

10“^ 

7.41 

10“^ 

7.51 • 


AC2 

10“^ 
9.95 - 

10“^ 

0.000 

10“^ 
4.97 • 

10“^ 
2.49 - 


AC2 

10“^ 
9.95 - 

10“^ 

0.000 

10“^ 
4.97 • 

10“^ 

S.S2 • 


ACS 

10“^ 
9.97 - 

0.000 

1 

o 

10“^ 
2.49 - 


ACS 

10“^ 
9.97 - 

0.000 

10“^ 
4.98 • 

10“^ 

S.S2 • 


CSA 

10“1 
7.01 - 

7.61 • 

10“^ 

7.SI • 

10“1 
7.46 - 


CSA 

10“1 
1.00 - 

7.01 - 

10“1 
8.51 • 

10“1 

8.01 • 


CGA 

10“^ 
1.2S - 

10“^ 

4.SO • 

10“^ 

8.SI • 

10“^ 

6.SI - 


CGA 

10“^ 
8.71 - 

10“^ 
5.71 - 

10“^ 

7.21 • 

10“^ 

6.71 • 



10“1 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 

[2,3] 

ABT 

1.07 - 

5.71 • 

8.21 • 

7.71 - 

[1. 1] 

ABT 

1.06 - 

6.21 - 

8.41 

8.41 • 


ASB 

10“^ 
9.01 - 

10“^ 

6.SI • 

10“^ 
7.66 • 

10“^ 
7.S9 - 


ASB 

10“^ 
1.04 - 

10“^ 
6.21 - 

10“^ 

8.SI • 

10“^ 

8.SI • 


ADC 

10“^ 
2.S8 - 

10“^ 
9.81 • 

10“^ 
1.68 • 

10“^ 
1.54 - 


ADC 

10“1 
l.SS - 

10“^ 
1.S9 - 

10“^ 
1.S6 • 

10“^ 

1.S6 • 


CBO 

10“^ 
8.S7 - 

10“^ 
1.00 • 

10“^ 
4.19 • 

10“^ 
S.S5 - 


CBO 

10“^ 
2.56 - 

10“^ 
2,02 - 

10“^ 
2.29 • 

10“^ 

2.29 • 


CBl 

10“1 
7.29 - 

10“^ 

0.000 

10“1 
S.64 • 

10“1 
2.91 - 


CBl 

10“1 
I.IS - 

10“1 
6.81 - 

10“1 
9.06 • 

10“1 

9.06 • 


CB2 

10“^ 
7.10 - 

0.000 

10“^ 
S.55 • 

10“^ 
2.84 - 


CB2 

10“^ 
1.04 - 

10“^ 
6.21 - 

10“^ 

8.SI • 

10“^ 

8.SI • 


ACl 

10“1 
8.61 - 

6.SI • 

10“1 
7.46 • 

10“1 
7.2S - 


ACl 

10“1 
9.41 - 

10“^ 
6,01 - 

10“^ 

7.71 • 

10“^ 

7.71 • 


AC2 

10“^ 
8.80 - 

10“^ 

0.000 

10“^ 
4.40 • 

10“^ 
S.52 - 


AC2 

10“^ 
1.04 - 

10“^ 
6.21 - 

10“^ 

8.SI 

10“^ 

8.SI • 


ACS 

10“1 
9.98 - 

0.000 

1 

o 

10“1 
S.99 - 


ACS 

10“1 
9.41 - 

10“^ 
6.01 - 

10“^ 

7.71 • 

10“^ 

7.71 • 


CSA 

10“^ 
1.04 - 

8.01 • 

10“^ 
9.21 • 

10“^ 
8.97 - 


CSA 

10“^ 
9.01 - 

10“^ 
6.11 - 

10“^ 
7.56 • 

10“^ 

7.56 • 


CGA 

10“1 
1.09 - 

10“^ 
5.61 • 

10“^ 
8.26 • 

10“^ 
7.7S - 


CGA 

10“^ 
1.04 - 

10“^ 
6.21 - 

10“^ 

8.SI 

10“^ 

8.SI • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10“^ 

10“^ 

[3,2] 

ABT 

1.06 - 

6.21 • 

8.41 • 

8.85 - 

[2. 1] 

ABT 

1.06 - 

6.21 - 

8.41 

9.14 • 


ASB 

10“1 
8.91 - 

10“^ 
6.11 • 

10“^ 
7.51 • 

10“^ 
7.79 - 


ASB 

10“1 
8.91 - 

10“^ 
6.11 - 

10“^ 

7.51 • 

10“^ 

7.97 • 


ADC 

10“^ 
8.71 - 

10“^ 
2.S2 • 

10“^ 
1.60 • 

10“^ 
1.45 - 


ADC 

10“^ 
6.71 - 

10“^ 
S.OS - 

10“^ 
1.85 • 

10“^ 

1.46 • 


CBO 

10“^ 
2.20 - 

10“1 
6.51 • 

10“1 
S.S6 • 

10“1 
2.7S - 


CBO 

10“^ 
2.20 - 

10“1 
6,59 - 

10“1 
S.40 • 

10“1 

2.S4 • 


CBl 

10“^ 
4.00 - 

10“^ 
6.5S • 

10“^ 
S.28 • 

10“^ 
2.6S - 


CBl 

10“^ 

0.000 

10“^ 
9.79 - 

10“^ 
4.89 • 

10“^ 

S.26 • 


CB2 

10“^ 
6.01 - 

10“1 
6.48 • 

10“1 
S.27 • 

10“1 
2.6S - 


CB2 

0.000 

10“1 
9.62 - 

10“1 
4.81 • 

10“1 

S.21 • 


ACl 

10“^ 
1.00 - 

10“^ 
4.40 • 

10“^ 
7.21 • 

10“^ 
7.77 - 


ACl 

1.09 - 

10“^ 
S.20 - 

10“^ 
7.06 • 

10“^ 

8.S4 • 


AC2 

10“1 
S.OO - 

10“^ 
7.S4 • 

10“^ 
S.68 • 

10“^ 
2.95 - 


AC2 

10“1 

0.000 

10“^ 
9,74 - 

10“^ 
4.87 • 

10“^ 

S.25 • 


ACS 

10“^ 

0.000 

10“^ 
9.98 • 

1 

o 

10“^ 
S.99 - 


ACS 

0.000 

10“^ 

1.000 

10“^ 
5.00 • 

10“^ 
s.ss • 


CSA 

1.06 - 

10“1 
6.91 • 

10“^ 
8.76 • 

10“1 

9.IS - 


CSA 

1.09 - 

4,00 - 

10“1 
7.46 • 

10“1 

8.61 • 


CGA 

10“^ 
8.91 - 

10“^ 
6.01 • 

10“^ 
7.46 • 

10“^ 
7.75 - 


CGA 

10“^ 
1.01 - 

10“^ 
8.41 - 

10“^ 
9.26 • 

10“^ 

9.54 • 



1 

o 

o 

1 

10“^ 

10”^ 



10“^ 

10“^ 

10”^ 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC 

Cost 

Alg 

FNR 

FPR 

CE 

NEC 

[3, 1] 

ABT 

1.06 - 

6.21 • 

8.41 • 

9.51 - 

[5, 1] 

ABT 

1.04 - 

6.91 - 

8.66 • 

9.8S • 


ASB 

10“1 
8.91 - 

10“^ 
6.11 • 

10“^ 
7.51 • 

10“^ 
8.21 - 


ASB 

10“1 
9.51 - 

10“^ 
6.71 - 

10“^ 

8.11 

10-^ 

9.04 • 


ADC 

10“^ 
4.20 - 

10“^ 
4.20 • 

10“^ 

2.SI • 

10“^ 
1.S7 - 


ADC 

10“^ 
1.90 - 

10“^ 

5.IS - 

10“^ 
2.66 • 

10-^ 

1.01 • 


CBO 

10“^ 
2.20 - 

10“1 
6.61 • 

10“1 
S.41 • 

10“1 
1.82 - 


CBO 

10“^ 
2.20 - 

10“1 
6.55 - 

10-1 
S.S8 • 

10-1 

1.27 • 


CBl 

10“^ 

0.000 

10“1 

1.000 

10“1 
5.00 • 

10“1 
2.50 - 


CBl 

10“^ 

0.000 

10“1 
9.94 - 

10-1 
4.97 • 

10-1 

1.66 • 


CB2 

0.000 

9.95 • 

10“1 
4.97 • 

10“1 
2.49 - 


CB2 

0.000 

10“1 
9.99 - 

10-1 
4.99 • 

10-1 

1.66 • 


ACl 

1.17 - 

10“^ 
2.60 • 

10“^ 
7.16 • 

10“^ 
9.4S - 


ACl 

1.21 - 

10“^ 
4.10 - 

10-1 

8.11 

10-1 

1.08 • 


AC2 

10“1 

0.000 

10“^ 
9.95 • 

10“^ 
4.97 • 

10“^ 
2.49 - 


AC2 

10“1 

0.000 

10“^ 
9.94 - 

10-^ 
4.97 • 

10-1 

1.66 • 


ACS 

0.000 

10“^ 
9.99 • 

1 

o 

10“^ 
2.50 - 


ACS 

0.000 

10“^ 
9.99 - 

10-1 
4.99 • 

10-1 

1.66 • 


CSA 

l.SO - 

10“1 
5.41 • 

10“^ 
9.21 • 

10“1 
1.11 - 


CSA 

1.S2 - 

10“1 
5.11 - 

10-1 

9.16 

10-1 

1.19 • 


CGA 

10“^ 
7.91 - 

10“^ 
7.71 • 

10“^ 
7.81 • 

10“^ 
7.86 - 


CGA 

10“^ 
7.71 - 

10“^ 
9.91 - 

10-^ 
8.81 • 

10-1 

8.07 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10-^ 

10-^ 

P, 1] 

ABT 

9.01 - 

9.61 • 

9.SI • 

9.08 - 

[10, 1] 

ABT 

9.01 - 

9.61 - 

9.SI 

9.06 • 


ASB 

10“^ 
9.51 - 

10“^ 
6.71 • 

10“^ 
8.11 • 

10“^ 
9.16 - 


ASB 

10“^ 
9.61 - 

10“^ 
5.81 - 

10-^ 

7.71 • 

10-^ 

9.26 • 


ADC 

10“^ 
2.00 - 

10“^ 
5.5S • 

10“^ 
2.86 • 

10“^ 
8.66 - 


ADC 

10“^ 
2.10 - 

10“^ 
6.07 - 

10-^ 

S.14 

10-^ 

7.4S • 


CBO 

10“^ 
2.20 - 

10“^ 
6.60 • 

10“^ 
S.41 • 

10“^ 
1.02 - 


CBO 

10“^ 
2.20 - 

10“^ 
6.60 - 

10-1 

S.41 

10-^ 

8.00 • 


CBl 

10“^ 

0.000 

10“1 
9.91 • 

1 

o 

10“1 
1.24 - 


CBl 

10“^ 
1.00 - 

10“1 
9.91 - 

10-1 
4.96 • 

10-^ 

9.10 • 


CB2 

0.000 

10“^ 
9.96 • 

1 

o 

10“^ 
1.24 - 


CB2 

10“^ 

0.000 

10“^ 
9.98 - 

10-1 
4.99 • 

10-^ 

9.07 • 


ACl 

1.24 - 

10“1 

4.SO • 

10“^ 
8.S6 • 

10“1 
1.14 - 


ACl 

1.18 - 

10“1 
5.61 - 

10-1 
8.71 • 

10-^ 

1.12 • 


AC2 

10“^ 

0.000 

10“^ 
9.95 • 

10“^ 
4.97 • 

10“^ 
1.24 - 


AC2 

10“^ 

0.000 

10“^ 
9.96 - 

10-^ 
4.98 • 

10-1 

9.05 • 


ACS 

0.000 

10“1 
9.99 • 

1 

o 

10“1 
1.25 - 


ACS 

0.000 

10“1 

1.000 

10-1 
5.00 • 

10-^ 

9.09 • 


CSA 

1.75 - 

10“^ 
5.91 • 

10“^ 
1.17 • 

10“^ 
1.61 - 


CSA 

1.4S - 

4.60 - 

10-1 
9.46 • 

10-^ 

1.S4 • 


CGA 

10“1 
8.01 - 

10“^ 
1.16 • 

10“1 
9.81 • 

10“1 
8.46 - 


CGA 

10“1 
7.01 - 

10“^ 
1.07 - 

10-^ 
8.86 • 

10-1 

7.S4 • 



10“^ 

10“^ 

10“^ 

10“^ 



10“^ 

10“^ 

10-^ 

10-^ 

[25, 1] 

ABT 

7.11 - 

1.20 • 

9.56 • 

7.SO - 

[50, 1] 

ABT 

7.41 - 

1.51 - 

I.IS • 

7.56 • 


ASB 

10“^ 
9.61 - 

10“1 
5.81 • 

10“^ 
7.71 • 

10“^ 
9.46 - 


ASB 

10“^ 
9.61 - 

10“1 
5.81 - 

10-1 
7.71 • 

10-^ 

9.54 • 


ADC 

10“^ 
2.60 - 

10“^ 
6.50 • 

10“^ 
S.S8 • 

10“^ 
5.00 - 


ADC 

10“^ 
2.20 - 

10“^ 
6.55 - 

10-^ 
S.S8 • 

10-^ 

S.44 • 


CBO 

10“^ 
2.40 - 

10“1 
6.40 • 

10“1 
S.S2 • 

10“^ 
4.77 - 


CBO 

10“^ 
2.20 - 

10“1 
6.55 - 

10-1 
S.S8 • 

10-^ 

S.44 • 


CBl 

10“^ 

0.000 

10“^ 
9.94 • 

10“^ 
4.97 • 

10“^ 
S.82 - 


CBl 

10“^ 

0.000 

10“^ 
9.86 - 

10-1 
4.9S • 

10-^ 

1.9S • 


CB2 

0.000 

10“1 
9.8S • 

10“1 
4.91 • 

10“^ 
S.78 - 


CB2 

0.000 

10“1 
9.9S - 

10-1 
4.96 • 

10-^ 

1.95 • 


ACl 

1.00 - 

10“^ 
9.71 • 

10“^ 
9.86 • 

10“^ 
1.00 - 


ACl 

8.01 - 

10“^ 
1.97 - 

10-1 
1.S9 • 

10-^ 

8.24 • 


AC2 

10“1 

0.000 

10“^ 
9.90 • 

10“^ 
4.95 • 

10“1 
S.81 - 


AC2 

10“^ 
2.00 - 

10“1 
9.95 - 

10-1 
4.98 • 

10-^ 

2.15 • 


ACS 

0.000 

10“^ 
9.98 • 

1 

o 

10“^ 
S.84 - 


ACS 

10“^ 
1.00 - 

10“^ 
9.90 - 

10-1 
4.95 • 

10-^ 

2.04 • 


CSA 

1.40 - 

10“1 
8.91 • 

10“^ 
1.15 • 

10“^ 
1.S8 - 


CSA 

10“^ 
2.85 - 

10“1 
1.00 - 

10-1 
1.4S • 

10-^ 

2.80 • 


CGA 

10“^ 
6.01 - 

10“^ 
1.18 • 

10“^ 
8.91 • 

10“^ 
6.2S - 


CGA 

10“^ 
5.61 - 

10“^ 
1.45 - 

10-1 
1.01 • 

10-1 

5.78 • 



10“^ 

10“^ 

10“^ 

10”^ 



10“^ 

10-1 

10-1 

10“^ 
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Cost 

Alg 

FNR 

FPR 

CE 

NEC Cost Alg FNR 

FPR CE NEC 

[100, 1] 

ABT 

6.91 - 

2.05 • 

1.37 • 

7.04 - 




10“^ 

10“1 

10“1 

10“^ 



ASB 

9.61 - 

5.81 • 

7.71 • 

9.57 - 




1 

o 

10“^ 

10“^ 

10“^ 



ADC 

2.20 - 

6.55 • 

3.38 • 

2.83 - 




10“^ 

10“1 

10“1 

10“^ 



CBO 

2.20 - 

6.55 • 

3.38 • 

2.83 - 




10“^ 

10“1 

10“1 

10“^ 



CBl 

2.00 - 

9.69 • 

4.85 • 

1.16 - 




10“^ 

10“1 

10“1 

10“^ 



CB2 

0.000 

9.73 • 

4.86 • 

9.63 - 





10“^ 

10“^ 

10“^ 



ACl 

5.61 - 

3.22 • 

1.89 • 

5.87 - 




10“^ 

10“1 

10“1 

10“^ 



AC2 

4.00 - 

9.51 • 

4.77 • 

1.34 - 




10“^ 

10“^ 

10“^ 

10“^ 



ACS 

0.000 

9.95 • 

4.97 • 

9.85 - 





10“1 

10“1 

1 

o 



CSA 

2.51 - 

1.10 • 

1.81 • 

2.50 - 




10“^ 

10“^ 

10“^ 

10“^ 



CGA 

4.90 - 

2.24 • 

1.37 • 

5.08 - 




1 

o 

10“1 

10“1 

10“^ 
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in all the graphs to have a common reference across the representations. 
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